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grams. 
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To the President of the Senate and the 
Speaker of the House of Representatives 

This is our fourth and final report in a series of 
reports on how the Departnient of Labor is iirplenient ing the 
Comprehensive Employment and Training Act of 1973. Prepared 
because of interest expressed by many committees and Members 
of Congress, it di:icusses classroom and on-the-job training 
activities authorized under title I of the act. 

We made our review pursuant to the Budget and Accounting 
Act, 1921 (31 U.S.C.^ 53), and the Accounting and Auditinq Act 
of 1950 ( 3J. U.S.C. 67) . 

We are sending copies of this report to the Director, 
Office of Management and Budget, and to the Secretary of 
Labor. a 
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Comptroller General 
of the United States 



COMPTROLLER GENERAL'S 
RLPORT TO THE CONGRESS 



JOB TRAINING PROGRAMS 
NEED MORE EFFECTIVE 
MANAGEMENT 



DIGEST 



Stronqer and rrore active Federal oversight is 
needed for job training programs to make sure ' 
that the larg*e amounts of the\ Federal dollaLS 
involved are being spent effectively. 

Title. I of the Comprehensive Employment and 
Training Act authorized the Department of - 
Labor to fund and inonitor locally adminis- 
tered programs to provide unemployed people 
with skills needed to find jobs. The act 
gav^e State and loqal authorities (called 
prime sponsors) a large role in planning and 
managing employment and training prograns . 

Labor makes grants to sponsors and provides 
technical assistance in developing plans, 
reviews plans to make sure that th» y meet 
legal and regulatory re^iuirements , and 
monitors sponsors ' activities. ^ 

About $1.8 billion of title I funr^j was spent 
for classroom and on-the-job trair ing programs 
during fiscal years 1975-77. 

GAO reviewed the effectiveness of trai^ning 
programs offered by 12 prime sponsors in 
six States — Cal if ornia , 111 inois , Massachu- 
settSr Minnesota, Nevada, and Wisconsin; ~ 
over $129 million was spent. 

PARTICIPANTS HAVE TROUBLE 
GETT ING AND KEEPING JOBS 

In a sample of over 2,000 classroom training 
participants who left training during fiscal 
year 1976, ^9 percent obtained jobs after 
completing training — many obtained jobs not 
related to the training received. {Si»e p. 6.) 
About 32 percent of tha sample found employ- 
ment and retained their jobs for at least 
6 months. 
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For a sample of over 800 on-the-job traininq * 
participants who left training during fiscal 
year 1976; 58 percent completed training and 
were retained by their employers. About 
38 perdent were with their training employer 
6 monthr: after training. (See pp. 23 and 24.) 

Many of those who left training oi their jobs 
were still unemployed at the time of GAO's 
contact—generally 6 months after the person 
left the program. (See pp. 8 and 24.) 

COST OF TR/^ INING VARIE D SIGNIFICANTLY 

One measure of prografK effectiveness is the 
cost—including such items as facilities 
and instruction, allowances , counsel ing and 
assessment services, and administration — 
incurred by placing participants in un- 
subsidized jobs . 

Classroom training costs ranged from about 
$2,800 per placement at one sponsor to about 
$15,100 at another. On-the-job training was 
less costly, ranging from about $1,500 per 
placement at one sponsor to about $14,600 
at another. 

The ^above , amounts relate to all placements,' 
whether or not the jobs related to the skills 
for which the participants were trained. The 
ccst to place participants in jobs using the 
skill for which they wero trained was cor- 
respondingly higher. (See pp. 9 and 24.) 

FACTORS AFFECTING TRAINING 
COMPLETION AND JOB RETENTION RATES 

The success of training programs may be af- 
fected by factors beyond the sponsor's con- 
tro.l, such as the motivation and capabilities 
of individuals served and the economic condi- 
tions of the sponsor's area. However, GAO 
found evidence that prime sponsors' programs 
need substantial improvements . 
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Sponsors in nany cases did not adi-qua'tely 
assess applicants to determine their employ- 
. ability, aptitude, ability, and interests 
before planning their employment goals. So-Tie 
participants were enrolled in training for 
which they were neither academically nor 
physically prepared. (See pp. 12 and 26.) 

Often counseling services, which provide par- 
ticipants with guidance in developing employ- 
ment goals and in helping to resolve problems 
thab. occur during training, were neither 
provided nor recorded. 

Participants left training or their jobs for 
such reasons as lack of motivation and trans- 
portation problems. (See pp. 12 and 25.) 

The act requires that training courses be 
offered in those occupations for which there 
are reasonable employment opportunities. Some 
of these courses, however, were not justified 
by available labor market surveys. Prime 
sponsors continued courses which had low 
placement rates and which labor market surveys 
forecasted as surplus or low-demand occupa- 
tions. (See p. 15. ) 

Some training courses did not provide par- 
ticipants with skills" needed to do the job. 
For ^example, less than a quarter of one spon- 
sor s clerical participants could type at the 
45 to 55 words per minute needed to qualify 
for available clerical jobs. (see p. 16.) 

Participants were placed in jobs which 

(1) were not related to their training, 

(2) were seasonal, (3) had a high turnover 
rate, or (4) did not pay much moie than the 
minimum wage. (See pp. 18 and 27.) 

PROGRAM MANAGEMENT AND EVALUATION 

Prime sponsors' abilities to administer their 
training programs were limited oy management 
information systems' deficiencies and by 
limited and superficial monitoring. Labor's 
monitoring of training activities was simi- 
larly limited. (See pp. 32 and 36.) 
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Labor has not established performance stand- 
ards although it has published performance 
indicators to measure title I programs' per- 
formance . 

However , the indicators are inadequate because 
they 'hiave been established for title I as a 
whole, not for each type of activity, such as 
classroom training. (See p. 29.) 

Existing management information systeiuS did 
not provide prime sponsors with data on 

(1) the success participants had in getting 
jobs in skill areas for which they were 
trained, (2) how long they kept their jobs, 

(3) the cost of training programs, and 

(4) why participants left the program or 

did not obtain employment. Some information' 
was also inaccurate and incomplete^ 

Labor representatives and prime sponsors were 
not adequately monitoring and evaluating 
training programs. As a result, officials 
were not aware of many deficiencies discussed 
in this report. 

Labor representatives did not per form indepth 
analyses of training program effectiveness. 
Instead, tney relied on (1) federally re- 
quired reports containing only general data ^ 

(2) prime sponsors* management information 
systems, and (3) impressions obtained from 
occasional site visits. 

Prime sponsors* monitoring efforts were simi- 
larly inadequate. 

The State Manpower Services Councils and the 
sponsors* planning councils did not perform 
the independent monitor ing and evaluation 
required by the act, but relied on data 
generated by the sponsors* management infor- 
mation systems and the quarterly reports 
submitted to Labor. (See p. 39.) 

V RE COMM ENDATIONS 

~ — I J. 

Recommendations in this report to the Secre- 
tary of Labor for improving program adminis- 
tration include 
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— offeriiiq training courses justified by 
labormarketsur'^eys; 

— documenting counseling sessions more pre- 
cisely, with particular attention to how 
participant problerrs are being solved; 

--developing more specific and appropriate 
performance standards for each training 
activity; and 

— revising the federally required reports to 
provide adequate information to evaluate 
tralining activities. (See p. 42.) 

Labor agreed with the thrust of GAO's recom- 
mendations. However, it, as well as the prime 
sponsors who commented on this report, believes 
that improvements have been made in the pro- 
gram. (See p. 44 and app. V.) 
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CljAPTEl^l 

T^^e delivery system for M.^st of the Deoartment of 
Labor s employment and training proqrams wak chanqed in 
December 1973 by the Comprehensive Employment and Trainir.q 
Act of 1973 (CETA) (29 U.S.C. 601). CEtX incorporates serv- 
ices previously provided under the Manpower DeveloDirven t and 
Training Act of 1962 (42 U.S.C. 2571), and parts of the 
Economic Opportunity Act of 1964 (42 U.S.C. 2701), and the ' 
Emergency Employment Act of 1971 (42 U.S.C. 4871). Emoloy- 
ment and training programs established under ether legi-.la- 
Icr'??q"r the emplovment security program ( Wagner-Pevser 

Act (29 U.S. v.. 49)) ana the Work Incentive proqram (Focikl 
Security Act (42 U.S.C. 630)), remain in effect. 

CETA, as amended, has eight titles: 

"-Title T authorizes grants to sponsors for comprehenG ive 
, ' employment, and training services. 

—Titles II and Vl/authorise funds for public service 
employment. 

—Title III, part, A .establishes employment and trainino 
programs for such special groups as Indians anii mi- " 
grants. Pdrc B au thor izes , research , evaluation, and 
training programs; a comprehensive labor market 
information system; and an aut-^mated job-r.tching 
system. Pact C escablishes various employment, 
training, and demonstration programs to explore 
methods of dealing with the structural unemployment 
problems of the Nation's youth. 

—Title IV maintains the federMly operated Job Corps 
program. . • ^^--f-^ 

""policy^ establishes a National Commission for Manpower 

— Tj.tle VII establishes provisions for xmpler.ient ing 
t M e act* 

—Title VIII establishes a Young Adult Conservation 
Corps to provide emoloypent aid^ other benefits to 
youths in useful conservation worK or other proi-'cts 
on Federal and non-Federal puhlic lands and waters. 
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C£:ta*h p'jrpose is to establish a flexible and decentral 
ized systen of Federal r State, a.id local programs for job 
training an] employment opportunities for economically dis- 
advantaged, unemployed, and underemployed persons, and to 
assure that these services lead to maximum opportunities 
and enhanced self-sufficiency for participants. 

CETA gives State anif local authorities, called prime 
sponsors, a greater role in planning and managing employment 
and training programs than they previously had. Instead of 
operating separate programs through almost 10,000 grants 
and contracts with public and private organizations. Labor's 
Employment and Training Administration now makes grants to 
445 prime sponsors — generally State and local governments — 
based on plans and programs the sponsors develop and Labor 
approves. Under CETA, prime sponsors -design and execute 
programs. Through its 10 regional offices,^ Labor provides 
technical assistance, approves plans, and moni-ors prime 
sponsors. Labor also must ensure that employment and 
training se : vices are available to target groups ^designated 
in CETA and tihat prime sponsors comply with its provisions. 

CETA encourages prime sponsors to use services and fa- 
cilities available from Federal, State, and local agencies. 
These include State Employment 5-ecurity Agencias ^btba;. 
State vocational education and rehabilitation agencies, 
skill centers, local educational agencies, postseccndary 
training and educational institutions, and community action 
aqencies. Prime sponsors may also use the services and fa*- 
c i li ties of the or iva te sec tor :/ bus inecses , employment 
agencies, educational and vocational institutions, and labor 
organizations. , ''^ 

compreh h:nsive employment and trai ning services 

Title I of CETA author izes^ grants to prime sponsors 
f or " comprehens ive efnployment and training services. Funds 
niay be used for 

— recruitment, orientation, counseling, testing, 
placernent, and followup services; 

— classroom instruction in occupl^t ional skills *' " 

and such job-rela ted tr a in ing as basic 
education; 
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— subsidized on-the-job training (OJT) by public and 
pr ivate employers ; 



— payment's to persons in training; 



~suppoctiv?» services such as necessary medical anc' 
child care, and bonding needed for employment; and 

funding jots in public agencies which eventual''y 
lead to permanent positions. 

Employment and training services involve bringing in- 
dividuals into a CETA program, assessing their needs, and 
developing and .'ipplemen ting a plan to achieve their empljv- 
xcnt gcals. The services provided include assessment, 
coun:5Pl^ng, job development, and followup, which ar ^ nect? - 
sary for successful training orograms. Assessment deterii nes 
whether and what employment and training prcgrams can ben^rf it 
a participant. It addresses such Issues as motivation, :.v r- 
conal problems and educational and ].'5nguage deficiencies, 
all of , which may hinder a person's ability to successfully 
complete training and obtain -employment . Counseling helps 
to sol 'e individual problems and includes job coaching, 
testing, and vocational or career guidance. 

After their needs , sKiils , and 30b potential have been 
assessed and matched with available job opportunities, par- 
ticipants are trained and assisted in obtaining jobs. When 
the person has been placed , followup services are provided 
to check on job^success and identify problems which require 
further counseling or possible changes in training. 

Supportive services are provided to participants to 
assist them in overcoming personal or environmental handicaps 
which inhibit employabil i ty . They' include such subordinate' 
services as health care, medical examinations, child care, 
and •"ranspor tation . 



FUNDING 



To obtain funding a prime sponsor must submit an annual 
plcn to Labor for e.pproval. This plan must describe oerform- 
ance goals and assure that services will be directed to the 
neediest persons. The prime sponsors generally distribute 
funds received from Labor to local organiza t i^ons for title I 
activities and determine the different services to be pro- 
vided. \ ^ 



13 



Since fiscal year 1975 — the first year of title I 
operations — through fiscal year 1977 about $1,8 billion has 
been spent to train participants in classroom and OJT train- 
ing programs. 

Title I Actu a l Expenditure s By Activity 
Fisc a l Year3 1975 to 77 

Fiscal 

Fiscal year Fiscal 

year 1976 year 

JL9I75 ( note a ) 1977 Total 

($000,000 omitted) 



Program 
activity 



Classroom training 


$249 


$578 


$549 


$1,375 


OJT training 


70 


180 


173 


423 


Public service 










employment 


56 


209 


93 


358 


Work experience 


375 


773 


566 


1,714 


Services to 










par ticipants 


90 


161 


145 


396 


Other activities 


9 


i: 


11 


35 


Total 


$849 


$1,916 


$1,537 


$4,302 



a/Includes the transition quarter from July 1 to September 30 
1976. 



We evaluated two major program activities authorized 
under title I — class*:oom and OJT training — which 1? prime 
sponsors operated. Our review sampled participants who 
left these ttaininq programs during fiscal year 1976. From 
fiscal years 1975 through 1977, over $129 million was spent 
by the sponsors for classroom and OJT train inq programs. 
A detailed discussion on the scope of our review and the 
method used is presented in chapter ^. 
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CH APTER 2 - 

CLASSRO OM Tf^AINING 

PROGRAMS N C CD SUBSTANTIAL IMP RO VEMENT 

Some participants in cJassroom training programr were • 
successful in obtaining and retaining employment, buL many 
were not,. Of the more than 2,000 participants sampled, about 
49 percent obtained jobs after completing training (many in 
nontrairiing related areas), and 32 percent were still working 
in those jobs 6 months later. Based on contacts made v/ith 
former participants and the number: who applied for unemploy- 
ment insurance benefits, the employment prospects for the 
other 68 percent were not good. Participants' wages afuer 
training increased only slightly over pretraining wages. 

Clatsroom training has not been more successful because 

--prime sponsor assessment practices resulted in enroll- 
ing participants lacking the ability, aptitude, Or 
interest to complete training or obtain jobs; 

— counseling failed to identify and resolve participants' 
problems, which subsequently resulted in participants 
leaving training or jobs; 

— some courses were in occupations for which there were 
poor employment prospects or provided insufficient job 
skills which did not improve participants' job poten- 
tial; and 

--job development and placement services often resulted 
in no job referrals, referral to jobs unrelated to 
training, and referral to seasonal or terrpoLary jobs. 

The cost of classroom training programs, when measured 
oqainst the standard of having participants obtain employment, 
vai'ies significantly. The costs varied because of differences 
in prime sponsors' operating expenses and placement rates. 

WHAT IS CLASSROOM TRAINING AND 
WHAT SHOULD IT ACCOMPLISH ? 

The purpose of title I of CETA is to provide training 
activities and services needed to enable individuals to secure 
and retain employment at their me ximum capacity. According 
to Labor's regulations, classroom training is any training 
conducted in. an institutional setting designed to provide 
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individuals with the skills and inforroation required to per- 
form a specific job or group of jobs. Further, CETA requires 
that training activities under title I — such as classroom 
training — be designed for occupations in which skill short- 
ages exist, and for which there is a reasonable expectation 
of employment for the individual. 

CETA prime sponsors, in many cases, contracted with the 
same training agents used by the pre-CETA centralized system, 
generally, skill centers. Opportunities Industrialization 
Centers, and community action or antipoverty agencies which 
offered, courses that only CETA participants attended. • How- 
ever, some referred CETA participants to community or junior 
colleges, vocational high schools, and private profitmaking 
schools. Under this individual referral program, CETA par- 
ticipants were enrolled in classes. that included non-CETA 
participants. Also participants were paid a weekly stipend 
while in training. 

HAS CLASSROOM TRAINI N G BEEN S UCC ESSF UL? 

Some participants in classroom training programs were 
successful in obtaining and retaining employment, but many 
were not. 

Man y classroom training par t icipants 
were not getting nobs 

None of the 12 sponsors reviewed met its goals for 
placing participants in jobs after training. About 49 per- 
cent of the sampled participants — both course completers and 
dropo'Jts — obtained jobs (many in nontraining related -areas ) . 
Job placement rates ranged' from 21 percent in Las Vegas-Clark 
County Consortium, Nevada, to 64 percent in Boston, Massachu- 
setts. (See app. I.) While some sponsors had placement 
rates significantly higher than others, all prime sponsors 
had so. e training courses with low-placement rc tes . Examples 
follow. 

Stanislaus Co unty, Califor n ia 

The sponsor had placed 24 percenc of the sample partici- 
pants- in jobs. In fiscal year 1976, an individual referral 
skill training program had only a 4-percent placement rate, 
compared to the sponsor's planned placement goal of 20 per- 
cent. Prime Sponsor officials w*ere satisfied with this per- 
formance because their target population was the economically 
disadvantaged (1) who, they believe, in many cases were 
coerced into training co remain on welfare; (2) who, because 
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they did not do well in school, will, not do well in CETA 
training; and (3) who are not real ly 'motivated to keep jobs. 
Apparently, sponsor officials did not believe ihat partici- 
pants' employment prospect's could be improved. Although CETA 
requires that sponsors identify individuals and positions for 
which there is a reasonable expectation of emplovment, par- 
ticipants were not tested to identify their aptitudes. 

Marlboro, Massachusettr 

The results of Marlboro's classroon training for all 
participants for 1975 and 1976 were reviewed. In fiscal year 
1975, 18 parcent of Marlboro's cJassroom training partici- 
pants obtained jobs after training. Because Marlbof^o had no 
monitoring system at that tir-.c, its officials were unaware 
of this. In fiscal year 1976 ,' t.^e placement rate increasod 
to 31 percent. In each year, Karlboio had planned to place 
51 to 64 percent of its participants. Subgrantee officials 
attributed the second year ' s low-placement rate to improper 
screening and assessment, and agreed that improvements were 
needed. Marlboro's reporting system had not improved signifi- 
caatly from one year to the next and a monitoring system was 
not established until the end of the second year. 

O akland, California 

In fiscal year 1976 the sponsor placed 62 percent of 
ttie sample participants. The placement rates for the 
10 skill training courses reviewed at the East Bay Skills 
Center ranged from 30 to .75 percent. The Skills Center had 
planned 80 percent placement of all participants. However, 
the prime sponsor made no changes to individual courses 
having low-placement rates in this training agent's program 
because it considered the agent's overall placement per forr - 
ance to be reasonable. A prime sponsor official said that a 
Classroom training agent's performance is good if the ovf^rdll 
results are close to tY.2 prime sponsor's 30-percent placement 
standard. 

Lowell ConsoLti nm, Massachusetts 

In fiscal year 1976, the sponsor placed 56 percent of 
the sample participants; its goal was 85 percent. Four skill 
training courses . of fered by the Lowell training agent (weed- 
ing, food service, clerical, and machine trades) had placement 
rates between 14 and 64 percent. Furthermore, nearly one-half 
of the placements were not related to the ti aining partici- 
pants received. Nontraining-related placements included such 
3obs as taxi driver, housekeeper, and stock clerk. However, 
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all four courses were continued in fiscal year 1977. A 
training agent official justified a welding course *:hat tiad 
a 14^percent placement rate because the resulting w^ges were 
higher than other courses. Lowell officials said they will 
reevaluate these course offerings. 

Some classroom training participan ts 

did not keep their jobs or obtain oTher jobs 

Although the purpose of title I of CETA is to assist 
participants in securing and retaining employment, many did 
not keep the jobs they obtained. To determine the employ- 
ment status of sample participants various means were used. 
These included (1) contacting initial employers who hired 
participants, (2) contacting participants, and (3) reviewing 
unemployment insurance records. About two-thirds of the 
sample participants who initially got jobs were still working 
at their first jobs 6 months after they. started work, based on 
contacts with initial employer s and participants. Six-month 
retention rates ranged from 26 percent (8 of 31) in Stanislaus 
County to 86 percent in both Chicago (43 of 5.0) and Minnesota 
balance-of-State (12 of 14). 

Many participants re^iained un*»mployed after training and 
marly applied fot unemployment insurance benefits. We obtained 
information regarding participant j who either applied for or 
received unemployment benefits after CETA participation at 
10 of the 12 prince sponsors. A review of aval lable ^4:nemploy- 
ment insurance recorcis for those participants who started 
training but were not placed in jobs for at least 6 months 
showed that 31 percent applied for unemployment benefits. 
We contacted 417 former title I participants who were not 
initially placed in jobs or were networking in the initial 
job 6 months later, and found that two-th ir^s were unemployed 
6 months after training. 

Prime sponsors did not obtain reasons for participants 
leaving their jobs . However , Boston , Massachusetts , and 
Santa Clara Valley, California, did special stuaies to 
evaluate the long-range effectiveness of their cJassroom 
tr&ininq programs by determining how long participantL kept 
their jobs, whether training 'skills were being used, and 
whether earnjngsincreased. 

About 16 percent of those in our sample who left their 
jobs d-d so tc take another. The remaining 84 percent left 
for reasons wh.'.ch included the following: 
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— Personal reasons. 

— Not suitably trained. 

— Lack of motivcitic i. 

— Poor attendance. 

— End of a seasonal job. 

It appears that participants leaving their jobs because they 
were not suitably trained or because they were placed on 
seasonal jobs demonstrates deficiencies in training courses 
and job developmen t procedures . To a lesser extent, the fact 
that participants leave their jobs because of personal and 
family problems, poor attendance, and motivation may reflect 
on the counseling or supportive services provided during and 
after CETA participation. 

Som e clansro om tra/nin g partic i pants 
received minimal wag e increase 

Fiscal year 1976 wage information reported to Labor by 
the 12 sponsors reviewed showed that the average increase in 
participants* wages was 15 percent. All sponsors reported 
an increase in par t xciiJcinLtj ' l-'OSL-CETA Wcjyes. Huwevet , at 
three sponsors, these wages increased by 4. percent or less 
over their pre-CETA wages upon entering unsubsidized employ- 
ment. However, if inflation is considered, the actual wag-? 
gain is less. Although th-^se figures are a composite of alj 
title I activities, we believe chey are somewhat representa- 
tive of wages earned after classroom training participation. 

Cost of classroom training 
var ied siqnif ican tly 

The purpose of title I is to provide comprehensive em- 
ployment services to enable individuals to secure and retain 
employment at their maximum capacity. Therefore, a basic 
factor that can be used to evaluate the success of title I 
training activities is the extent to which former trainees 
obtained and retained employment. To measure results, co3t 
was calculated on a per placement basis. 

We computed costs including facilities and instruction 
costs incurred by classroom training programs in placing par- 
ticipants in unsubsidized jobs , using prime sponsor cost and 
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pla.cement records for the 12 sponsors reviewed. We allocated 
such indirect cost? as training allowat*ces, counseling, and 
assessment .services based an yearly enrollment statistics , and 
prime sponsor administrative costs based on each activity's 
total of direct and allocated indirect costs. We computed 
cost per placement for the classroom training programs by 
dividing the prime sponsor's fiscal or calendar year costs 
for these programs by each training program's placements for 
that year. 

Although ejpployment is the most obvious and tangible 
factor , other less tangible factors—while not readily suscep- 
tible to measurement — should not be overlooked. For example, 
although some traiwc<*s may not have obtained employment when' 
they left the program, they may have increased tneir employ-- 
ability. Some participants also received other benefits such 
as basic education, medical assistance, and financial aid. 
Therefore, although relating all program costs to only those 
participants who complete and obtain jobs is not without 
question, we believe it is valuable for comparing the-rela- 
tive effectiveness of different training activities. . 

We computed the average cost of training the partici- 
pants who terminated during fiscal year 1976 at our selected 
12 prime sponsors to be $2,100. However, when all the above- 
mentioned costs are related only to participants who were 
placed in jobs, the cost of training and placing participants 
varied significantly— ranging from about $2,800 at one sponsor 
to about $15,100 at another. 

We also calculated the cost per training-related 
placement. Although its use has some of the same drawbacks * 
as the cost per placement, we believe it is useful for measur- 
ing the cost effectiveness of various programs, particularly 
since classroom training is directed tov:ard developing job 
skills that will enable participant's to compete for jobs in 
the particular occupation involved, when all costs are as- 
signed only to training-related placements, the cost of 
training a participant for a skill and placing the person 
in a job using that skill not only showed an increase— as 
would be expected—but showed substantial variations, ranging 
from about $3,700 at one sponsor to about $27,600 at another. 
(See app. II . ) 

Based on the sample, about three-fourths of those placed 
got training-related jobs and about one-half of these were 
still working 6 months later. As discussed in chapter 4, 
Labor does not have precise indicators for measuring the 
cost effectiveness of different training activities and does 
not receive this data from prime sponsors. 
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WHY HAS CLASSRO OM TPi^INING NOT , 
BEEN MORE SUCCFS ^ .^UL ? 

The problems which limit classroom training's effective- 
ness are discussed below. 

# 

Reasons participants left trairiin g 
or failed to obtain employmen t 

Although CETA's objective is to provide training and 
services leading to employment, participation in Classroom 
trarining prograir^s often did not lead to jobs. There are many 
reasons why participants did not complete training or failed 
to get jobs after completing training. The methods prime 
sponsors used for documenting why participants left training 
programs before completion were too general apd imprecise to 
evaluate. Termination categories such as "administrative 
separation" a.'d "refuse to continue" are not sufficiently 
de5;criptive anJ may disguise program weaknesses. For example 
in Boston^ participants were classified as "adminis tr: tive 
separation" when they were actually terminated for excessive 
absenteeism. 

Because prime sponsors did not summarize this informa- 
tion, we identified the reasons. After reviewing counseling 
files and talkinr, with participan*:s , we used judomenc in 
classifying such ambiguous reasons as administ r i '^e «;^nar;^- 
tion and refusal to continue. 'Reasons were classified as 
positive or nonpcsitive by following sponsor records which 
used the same tei:ms. Some reasons were beyond the sponsors* 
control, such as poor local economies, but some evidence 
indicated inadequate training and related supportive services 
The reasons participants did not complete training or failed 
to get jobs after completing training are summarized on the 
following page. 
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^^umber of 
p art i : pants Percent 



Nonpositive reasons for termination: 

Refused to continue 173 

Health 87 

Unable to find participant a job 79 

Moved fromarea 72 

Personal/f ah » : V i^roblems 49 

Absenteeism, 42 

Administrative separation 15 

Trcinsportation problems 14 

Lack cf interest/motivation 12 

Poor perfor:nance • 5 

Other c 



Total nonpositive reasons 

Positive reasons for termination: 
Entered other program 
Entered school 

Found job prior to completing 

training 
Entered military 



Total positive reasons 
Total identifiable reasons 



Unknown (p.ote a) 

Total 1,051 

a/This includes former participants which the pr ime ' sponsor 
and, the General Accounting Office were unable to locate, 
those classified as placements who never reported to the 
job, and those for which no explanation was provided. 

The nonpositive reasons account for about 83 percent of 
Che known reasons f or par ticipants leaving training or not 
getting jobs. We believe many nonpositive terminations could 
have been avoided had proper program services )been provided. 

Assessment procedures should identify 
individuals who desire~a nd are capable 
of c ompleting trainincy 

According to Labor guidelines, assessment involves 
determining each participants employabil i ty , aptitudes. 
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abilities anc interests, and developing a plan to achieve 
the participant's employment and related goals. Assessment 
may be accomplished by in terv iev/ing , testing,, and counseling. 
While all J2 sponsors interviewed participants, only five — 
including thc^ four sponsors with the highest placement rates 

.based on the sample — tested participants to determine their 

^ptitude^ and abilities. 

In Marlboro, one official said that the major reason for 
nonplacement was improper assessment and selection of partici- 
pants for certain training courses. . For example, participants 
were needed for training courses that were scheduled to begin 
ip 1 week. As c) result, they were hastily recruited with no 
assessment. Another Marlboro official stated that, generally, 
these participants were unsuitable for classroom training. 

Sanna Clara Valley classroom training agents tested 
applicaiics' mathematical and reading comprehension prior to 
enrollment to determine if they had the ability to comfPlete 
training. Conversely, Lowell did not test applicants prior - 
to course entry, due to potential discrimination charges if. 
they refused a person admission to a training course based 
on test results. For example, Lowell enrolled par ticipants ■ ' 
m a machine occupations training course who lacked basic 
mathematical skills needed to do the job. Once participants 
demonstrated zr. inability to handle the training, they were 
terminated from the program. 

Assessment procedures should also identify participants 
with physical disabilities or other impediments that hamper 
successful training or job placement. This was not always 
done. In Oakland, a participant with Hodgkin's disease was 
enrolled in a course from which he eventually withdrew because 
of the strenuous physical training requirements. Similarly, 
in Lowell, a participant with epilepsy was enrolled in a 
welding course and because of his handicap was unable to 
perforin the required work. He subsequently withdrew from 
the course. Both participants should have been enrolled in ' 
less strenuous courses where they could perform the required 
work. 

^Thorough assessment procedures are necessary to identify 
those participants who have the desire and potential to 
successfully complete training and obtain training-related 
employment. Failure to adequately assess participants' 
abilities, interest, and aptitudes results in more partici- 
pants failing to complete training and fewer participants 
obtaining training-related employment- According to two 
sponsor officials, there are waiting lists of applicants 
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who are accepted on a f irGt-come-f irst-servf d basis, and ' 
not by qualifications. This could.be a disservice to both 
those who were inadequately selected and those Qualified 
participants who are turned down because the program wac 
filled. In addition, the cost to place p-rlicipants in- 
creases * cor respond ing J y * 

Adequat e counsel inq needed_to 

im prove clients' em proymey: op portunities 

Labor guidelines define counseling as assisting Dartici- 
pants in realistically assessing their needs, abilities, and 
potential; providing guidance in^devoloping vocational goals 
and the means toachieve them; and heipin9 participants solve 
various inc^ividual problems occurring f^uring CETA participa- ^ 
tion. Labor guidelines define support-ive services as assist- 
ing individuals in overcoming personal ot environmental handi- 
capr. which inhibit thexr employab: liilV . These services in- 
clude transportation, health care,/child care, legal assist- 
ance, emergency aid, and assistance in obtaining housing. 
Failure to provide these services may reduce participants' 
likelihood in completing training programs, getting jobs, and 
keeping them. ^ j # « 

As. indicated on page 12, man- participants who failed 
to complete training or obtain jobs might have ^een helped 
in some way. More, interi^ive counseling or referring the' 
participant to other agencies for supportive services could 
hf.'ve resolved some problems. 

Prime sponsors or the State Employment Security Aqency 
and the training agents undor contract to. the prime sponsor 
provided counseling to participants. However, counselir- 
records were not maintained for .nany par ticipan^ts and ;ns 
were not proper ly recorded . As a result, it could not • 
determined i.f counselors identified and adeouately atte;^ j 
to resolve the par t icipants,' problems . Examples of pr ie-.ns 
which may have bevtn resolved oy counseling and supportive 
services follow. 

A Boston counselor's records indicated that one partici- 
pant was most uncooperative, had a poor attitude, and had un- 
acceptable attendance and tardiness patterns. Howeve^, 
counselxng records did not indicate that any attempt was made 
to Identify the cause of the participant's problems or ''olve 
them. The participant was suosequently terminated as an 
adminis tr at ive separation . 
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A Lowell counselor's comnents indicated that one partici 
pant had attendance problems due initially to sickness and 
then to child-care problems. However, nothing indicated tnat 
any attempt was nade to resolve the participant's problems 
t^y referring the participant to a child-care facility. The 
t^atticipant was terminated for refusing to continue. 

_ A Las Vegas participant was terminated because of a" 
transportation problem, but nothing indicated that the par- 
ticipant was counseled, or an attempt made to resolve the 
!f -^^^^'^^u'"^ problem. m Stanislaus County, a particioant 
sa.d that he dropped out of training because he "couldn't- 
get with It." He also said that he needed counseling, but 
was unaware that it was available. 

Training courses with poor 

empl-oyme nt prospects were being offered 

CETA requires that classroom training be designed for 
occupations in which skil 1 'shor tages exist, and that partici- 
pants not.be referred to training unless, the prime sponsor 
has determined tnat reasonable employment opportunities exist- 
in the occupation for whi^.^ they are being trained." .However' 
some prime sponsors continued offering courses with unfavor- 
able labor market demand and poor past performance. 

Some sponsors were offering skill training courses in 
occupations which did not have either skill shortaces or 

?^Mn^vi ,^K°^^^''^u- example, Springfield's (H.mpden 

county) labor market survey indicated littl- demand for par- 
ticipants compxeting eleccrical appliance and refrigeration 
repsir, food service, and metal fabrication training courses 
About a third of those completing these courses obtained 
training-related jobs. In spite of this, all three courses 
were continued into fiscal year 1977. Oakland's SESA labo. 
market survey indicated a surplus of marginally qualified 
fnJnrl!!!^ "'"^ 9 1 oce r y c hec ke r s , and cooks. Even with this 
■f ifcil ii^r rates of about 45 percent during 

fisca^^^a^i977 :- — ^ 1^"^ "^^^ "''^ continued into 

Hm^,- '^-i!b°'^,"ia'^ket survey performed by the BosTorrrp-^hsor - -. 
during fiscal year 1975 indicated unfa^•orable job orospects 
for iJarticipants completing metal f abr :.cation and electro- 
mechanical training courses. The prime sponsor disregarded 
the data and continued the courses into fiscal year 1976 

rater'??irn''"^i^^,^^ °^ ''^^''^ two course., showed low-placement 
5f^r M^r? P^i""^-?^^ ^'hich substantiated the fiscal 

year 1975 forecasts of the labor market survey. 
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iHfn??f^!''^!'^^^°u"" '^''^ perform .labor marlcet studies 
to Identify skill-shortage occupations. For example, the 
Lowell sponsor, and the- Fall River, Massachusetts, and the 
Minnesota balance-of-State subgrantees do not have the capa- 
bility or resources to identify skill-shortage occupations. 

i'^^^'u"^^ ^^f Bo^'^o"' Hampden County, and Chicago sp^n- 
-.crs do labor market surveys, they primarily rely on oas- 
course performance, participants' occupational desires, and 
training agents' assurahces that job opportunities exist. 
None of these are adequate for forecasting future employment 
-opportunities. As a result, these prime sponsors contS 
training courses, regardless of placement results and labor 
market information. The fixed investment by prime sponsors 
in course equipment ar.d instructors is one'possible reason ' 
tor their reluctance to tUscontinue training courses with 
unfavorable job prospects. 

Some classroom training programs may no t 
provide sufficient Tob skiTli ~~ 

Labor's regulations require that classroom training ' ■ 
provide participants with" the necessary technical skills to 
perform a specific job or group of jobs. Some participants ' 
in training activities at selected sponsors did not obtain 
sufficient skills to obtain jobi,.. In the evaluation, we did 
not try to determine whether the par ticipa'^«-'= • ^ r.r-„f^ ; 
Dob skills were due to poor course structure or "the'inabil i ty 
to learn the skill. ^ xx^y 

skill ^"of^^w^^U occupations require minimum typing 

skills of 45 to 55 words per minute.' But less than a quarter 
ot tne sampled clerical participants could type at that rat^ 
after training; as a result, many could not get jobs. 

'he Marlboro subgrantee had similar problems with its 
r!Tfl?"^' training course in which there was only one training- 
Itl ^ placement out of twelve sampled participants. Two of 
^^L^"" f^^^ keypunchers were refused employment because 

they filled an employer's keypunching test given to all pro- 
spective employees. ' 

The Lowell sponsor pr ov ided ^ par t ic ipan ts with skill 
sampling rather than skill training. In skill sampling, 
participants are given an introductory exposure to a skill 
Which should qualify them for entry-level positions\ In ' 
discussions with 29 employers, 20 stated that participation 
ui Lowell's program had little^or no influence in their hiring 
decisions. They stated that participants would, have been ■ 
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hired regardless of any prior training, and their participa- 
tion ga\^' them no advantage over other job applicants without 
this training. Skill sampling for entry-level positions 
requiring minimal or no training did not improve advancement 
opportunities for participants and may not represent the 
most economic use of classroom training funds. 

In Boston, a training agent • of fered a computer programing 
course which resulted in no training-related placements for 
sample participants. Although the job developer acknowledged • 
that the computer programing trainees could not compete in 
the job market due to their lack of adequate skills, the 
course was continued into fiscal year 1977. 

Pre vocational training should 1 e ad 
to occupational skill training 

Labor's regulations permit classroom training to be used 
to enhance individuals' employability by upgrading basic 
slifills through remedial education. Some prime sponsors re- 
viewed offered pr evocational training, such as Engl ish-as-a- 
second language. Some tried to place participants directly 
into employment upon completing their pr evocational training, 
while others placed participants in occupational traininq 
courses after completing their pr evopa^tional training. 

Marlboro, Massachusetts, and Lake County, Illinois, 
generally tried to place participants directly into jobs 
after prevocational training, but less than a quarter of them 
got jbbs. In Marrlboro, only 1 of 11 participants who received 
English-as-a~second language training obtained a job. In La^c 
County, from-CETA's inception to the. summer of 1976, there 
were 375 participants who took prevocational training, of 
'wliom 39 (10 percent) transferred to other employment and 
training -program.-? . Of 68 prevocational participants sampled, 
16 {24 percent) obtained jobs after completing their pre- 
vocational training. Furthermore, the types or jobs these 
^ participants obtained generally required little or no formal 
training and were low-paying, unskilled positions, such as 
waitresses, packers, and housekeepers. 

Conversely, Boston, Lowell, and Springfield couoled 
prevocational training w\th occupational skill training, and 
their placement rates were significantly higher than those 
recorded in Ma'rlboro and Lake County. In Boston and Lowell, 
participants receiving prevocational training ar.e expected 
to later enroll in an occupational skill-training course. 
In Springfield, participants requiring prevocational training 
take this instruction in conjunction with a skill-training 
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course. For example, they may receive basic educational 
instruction in the morning and machine shop training in the 
afternoon, 

Prevoca tional training is allowed under Laboi's regula- 
tions. However, it was of questionable benefit provide 
only prevoca tional training, as Marlboro anr! LdKe County did, 
to individuals who apparently did not have a job skill. This 
activity did not appear to meet CETA's purpose of assuring 
that training and other services sponsors provided would lead 
to maximum employment opportunities and enhanced self- 
sufficiency. 

Inadequate job- dev e lopme nt/pl acemen t 
serv i ces pr ev ent par tici pan ts from 
o btain in g trainin g- related emplo yment 

Labor guidelines state that job development is an ongoing 
process to ensure placement in the participant's selected 
vocation shortly after training is c npleted. Job develop- 
ment's purpose is to get participants into productive jobs 
where they will become self-sustaining and will have oppor- 
tunities for career advancement. Many participants, however, 
did not get job referrals attei training; others were placed 
in nontraining-related positions, or in seasonal or temporary 
jobs . 

Most prime sponsors contracted with SESA to provide job 
development and placement services for classroom training par- 
ticipants. Because training and job development are generally 
performed by different agencies, it is difficult to determine 
whether poor placement and training-related placement rates 
result Hroir inadequate training or poor job development ef- 
forts. Problems could also be due to an unfavorable job 
market. 

Springfield and Oakland training agent officials said 
that one caust^ of participants not getting jobs was SESA's 
-inadequate job development efforts. The Springfield training 
agent official stated that SESA job developers lacked motiva- 
tion to actively seek- jobs for participants. On the othej: 
hand, both Spr ingf ielcj^nd Oakland SESA officials stated that 
training agents only £efer participants they cannot place. 
Additionally, an Oakland SESA official stated that the train- 
ing agent did not give- them timely notice when participants 
would be ready for pla^ci^ment. 

In Stanislaus County, SESA was contractually responsible 
for having jobs ready for participants upon completion of 
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training. The review showed that SDSA job development efforts 
began only after the participant had completed training, aVid 
then only after the school and participant first exhausted 
^their job posj;; ibi 1 i t ies . At that time, SESA contacted partic- 
ipants who had completed training to update their job appli- 
cations and to provide placement services. After this ini- 
tial contactr it was the participants' responsibility to qo 
to SESA monthly to remain eligible for placement services. ''^ 
Little effort was made to contact or place participants. 
When this situation was pointed out to sponsor officials, 
they said they would improve their operations. 

These situations demonstrate that better cooperation 
between training agents and SESAs in providing job develop- 
ment and placement services to participants is needed. Our 
report, "The Employment Service — Problems And Opportunities 
For Improvement," HRD-76-1^9, dated February 22, 1977, dis- 
cusses the need for more effective and efficient services to 
job seekers. 

According to Labor's regulations, classroom training 
should be designed to provide participants with the technical 
skills to perform a specific job or group of jobs. Therefore, 
participants should expect to obtain jobs for which they 
have been trained. Of 12 prime sponsors reviewed, all had 
participant goals but 10 had no training-related placement 
goals. Many participants at nearly all sponsors were placed 
in jobs not training-related such as 

— a Boston auto-.'nechanics trainee hired as a hospital 
pa tien t escor t , 

— a Springfield electrical appliance and refrigeration 
trainee hired as a bathtub and sink repairman, 

— a Lowell welding trainee hired as a taxi driver and a 
machine trades trainee hired as a photocopy machine 
opera tor , 

— a Chicago welding trainee hired as a porter and a 

television repair trainee .ired as a material handler, 
and 

— two Stanislaus County basic mechanical skills trainees 
hired as egg gatherers. 

As Labor guidelines note, job development efforts should 
begin before participants complete training so they can 
start work immediately after completing their training. 
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However, many sponsors' particioants did not receive referrals 
to job interviews before completing training. Fcr example, 
in Oakland, seven of eight sa»T^ple participants completing a 
training agent's auto mechanics or culinary arts course did 
not receive a job referral. The agent shared job developmt^n^ 
and placement responsibility with the State's employment 
security office. A training agent official said inadequate 
]ob development and placement services caused the two courses' 
low placement resultr-. Training agent records indicated that 
there was little or no assistance for most sample participants 
who were not placed. An official of another Oakland training 
agent, who placed less than half of his participants, agreed' 
that job placement efforts were often unsuccessful. He 
stated that he lacked adequate staff to provide sufficient 
job development and placement services. 

In Santa Clara Valley, two participants were in a "hold 
for placement" status for over 30 days after tiraining but 
they received no job referrals during that time. Sponsor's 
subsequent attempts to contact them were fruitless and they 
were terminated. A training agent's official said that its 
inadequate job development was a factor in low placement 
rates. To improve placement results, he had replaced two job 
developers. 

In Boston, job developers for the training agent placed 
four keypunch trainees in seasonal positions in a department 
store. All were hired during the second week of November and 
terminated at the end of December. Shortly thereafter, a 
Boston agent identified 21 keypunch jobs, but did not refer 
any participants to those jobs. A classroom training official 
sa;.d no job referrals could have been made because the key- 
punch'courso was iu progress. However, nobody contacted prior 
keypunch trainees who did not obtain ^obs or tiiose terminated 
from the seasonal positions mentioned above. 
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CHAPTER_3 
NEED TO IMPROVE ON-THC-JOB TRAINING 



PROGRAMS^ TO ENHANCE J0 3 RETENTION 

On-the-job training offers the opportunity to learn and 
develop job skills under a supervisor's guidance at an em- 
ployer's place of business, OJT may train participants for 
entry level jobs or upgrade employees into occupations re- 
quiring higher skills. Training should lead to fully 
developing a participant's potential and economic self- 
sufficiency. Private employers provide training and are 
reimbursed (by the sponsor) for one-half of the partici- 
pants' wages during training. 

Some OJT participants were successful in comoleting 
training and remaining with training employers on an un- 
subsidized basis; many were not. About 58 percent of the 
809 participants sampled obtained unsubsidized employment 
after the OJT period; and about 38 percent were still work- 
ing for their employers 6 months after completing OJT. Many 
of the regaining 62 percent remained une^pployed, as evidenced 
by (1) contacts with them and (2) those applying for unemo^oy- 
inent benefits. " 

OJT has not been more successful because: 

— Prime sponsor assessment practices resulted in enroll- 
ing participants lacking the ability, aptitude, or 
interest to complete training. 

— Counseling failed to identify and resolve participants' 
problems, which subsequently caused participants to 
leave their jobs during or shortly after training. 

—Job development and placement services resulted in 
participants being trained for jobs which had high 
turnover rates, were seasonal in nature, required no 
craining, were low-paying, and resulted in lay-offs. 

The cost of OJT programs, when measured against the 
standard of having participants complete training and remain 
as a regular employee, varies significantly. Although the 
average cost of training participants who terminated dur ing 
fiscal year 1976 at the 12 selected prime sponsors was $1,700, 
the cost of placing an OJT participant with an employer and 
having that person complete training and remain as a regulai 
employee varied substantially because of differences in 
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(1) length of training, (2) wage rates paid, and (3) the 
unsubsidized tmploynient rnte among sponsors. ' 

WHAT IS QJT AND WHAT SHOULD IT ACCOMPLISH? 

OJT is conducted in a work environment in which partici- 
pants can learn an occupational skill oi qualify for an occu- 
pation through demonstration and practice. The work environ- 
ment is usually provided by a private, profitmaking employer. 
OJT may be conducted on a ^'hire-f irst , train-later" basis or 
with ultimate placement at a different employer. In practice 
participants at the 12 sponsors reviewed were hired by the 
OJT einployer when training started. This presumes that after 
completing training the participant will be retained as a 
regular employee, solving the problem of finding suitable 
employment after training. 

Mo.-^t prime sponsors contracted with State Employment 
Security Agencies to operate their OJT programs out a few 
contracted with private nonprofit organizations to operate 
the program. 

These contractors visit employers to encourage their 
participation, negotiate OJT contracts, and help employers 
apply for Federal trail. ing allowances. Prime sponsors 
reimburse participating employers for such program costs as 
training and supportive services beyond tho^o ^H*» ^mnloy-^r 
normally provides. Generally, reimbursement is 50 percent 
of the hourly wage paid during the training period. 

OJT periods ranged from 7 to 40 weeks, depending on the 
occupation in which the participant received training. In 
determining OJT periods, prime sponsors used Labor publica- 
tions showing the time frame needed to acquire the skills. 
Some sponsors avoided low-paying positions by acceptinc^ only 
these job? with a starting wage of at least $3.00 per hour. 

HAS OJT BEEN SUCCESSFUL? 



Many sample participants failed to complete training or 
obtain unsubsidized employment after training. (See 
app. III.) About two-thirds of those who did obtain un- 
subsidized jobs kept them for at least 6 months. Many, who 
neither completed training nor kept their jobs for 6 months, 
were unemployed when contacted. Generally, our contacts were 
6 months after the participant left the program. 
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M any part ici o an ts do not com plete QJT and 
obtain unsubsidized employment 

Based on the sample, most sponsors did not meet their 
OJT pllacement goals. Of the 809 participants sampled, 467 
v58 percent) completed training and were retained by their 
employers in unsubsidized positions. Placement of sample 
participants in unsubsidized jobs varied from 20 percent at 
Marlboro to 82 percent at Las Vegas. Most prime sponsors 
bel ieved their per f ormance was satisfactory . In some cases , 
sponsors lowered their goals to put them more in line with 
their performance. Examples of prime sponsor activities 
follow. 

Lake County, Illinois 

At Lake County, 17 (47 percent) of the 36 sampled com- 
pleted OJT and were retained by their employers. The sponsor 
believed this performance was satisfactory because the spon- 
sor's goal measured ajainst the OJT program was 50 percent. 

Stanisl a us County, California 

At Stanislaus County, 73 (48 percent) of: the 152 sampled 
completed OJT and were retained by their employers. Reacting 
to this performance, the prime sponsor reduced its coir.pletion 
goal from 80 to 70 percent. 

Marlboro, Mass^ch'^jcet ts 

In fiscal year 1975, Marlboro had to cancel 14 of the 
17 job slots developed because (1) those eligible applicants 
referred to employers were not accepted for job training 
and (2) employers initially interested in providing training 
suddenly experienced financial problems. In fiscal year 
1976, Marlboro funded the same training agent and 20 percent 
of the sample completed r.raining and were retained by their 
employers. The subgrantee's goal was 60 percent. The sub- 
grantee evaluated the training agent based only on the 
agent's ability to develop and fill slots, not on the number 
of participants completing training and retaining jobs. 

Boston, Ma s;sachu setts 

/ 

In Boston, 7 (23 percent) of the 24 sampled compl^^ed 
OJT and were retained by their employers? the goal waf 90 per- 
cent. Also, only 129 of 200 planned slots were deve^Voped 
during a 15-month period. The training agent attri>juted the 
low number of slots developed to a poor job ir.arkef/^ However, 
neither the training agent nor the sponsor could/substantiate 
that the poor job market affected job developme,r{t efforts. 

/' 

/' 
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After evaluating the results of our review, Boston decided to 
drop the training agent and negotiate with another one in 
fiscal year 1978. 

Some OJT ^.articipants do not keep thei r 
unsubsidized jobs or obtjin other -j Hbs 

To determine the employment status of sample partici- 
pants various mee-ns were used. These included (1) contact- 
ing the hiring employer, (2) contacting the participants, and 
(3) reviewing unemployment insurance records. Of the 809 par- 
ticipants sampled, 305 (38 percent) were working with their 
employer 6 months after placement; while 504 (62 percent) 
either did not complete training or were not retained by their 
employer for at least 6 months. According to the prime spon- 
sors records and our contacts with employers, 95 quit train- 
ing or left their unsubsidized jobs to accept positions else- 
where. Of the 123 participants that we contacted, about 
two-thirds were employed, although less than half of these 
•had jobs related to their training. 

The poor employment prospects of these 504 former partic- 
ipants are illustrated by their reliance on unemployment in- 
surance afttr leaving their jobs. A review of available un- 
employment insurance records foi: 439 of these former oartici- 
pantc showed that about 48 percent subsequently applied for 
unemployment benefits. 

Cost of OJT varied significantly 

The cost of OJT was calculated on a per placement basis. 
{bee discussion of classroom training costs in ch. 2.) The 
average cost of training a participant with an employer for 
OJT who terminated during fiscal year 1976 at the 12 selected 
prime sponsors was $1,700. However, significant variations 
occurred when all OJT program costs were assigned to only 
those v,ho ultimately got an unsubsidized job. On this basis, 
the costs of OJT training and successfully placino partici- 
pants in unsubsidized employment after completing 'oJT ranged 
from $1,500 in Oakland to $14,600 in Boston. (See app . IV.) 
During fiscal year 1976, Boston spent $483,000 for its OJT 
program and 33 people were placed in unsubsidized employment, 
while Oakland spent less money and placed eight times as many 
participants in unsubsidized employment. Labor did not have 
precise indicators for measuring cost effectiveness and the 
sponsors reviewed lacked such measures. Therefore, neither 
Labor nor sponsors were able to take or recommend action to 
revise or terminate the higher cost programs. 
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WHY HAS OJT NOT BEEN MORE SUCCESSFUL? 



The problems which limit OJT's effectiveness follow. 

Reasons p ar ticipants l eft trainin g 
or did not obtain a job 

Of the 809 participants sampled, 342 (42 percent) quit 
training or did not obtain unsubsidized jobs. Many reasons 
for this exist, but prime sponsors generally did not tabulate 
them. After reviewing counseling files and talking with par- 
ticipants, judgment was employed to classify such ambiguous 
reasons as administrative separation and refusal to continue. 
We classified reasons as positive or nonpositive by following 
prime sponsor records which did the same. Some reason^ for 
quitting training or not obtaining unsubsidized jobs ai i 
beyond the prime sponsor's control, however, other evidence 
indicated inadequate training and related supportive services. 
The reasons participants did not complete training or failed 
to get. jobs after completing training are summarized below. 

Number of 
par tic i pants Percent 

Nonpositive reasons for terminalion : 

Personal problems 38 

Laidoff j3 

Not suitably trained 28 

Absenteeism 26 

Health 21 

Poor performance is 

Moved froir area 14 

Lackcfmotiv.ition I3 

Miscor.duct/jailed 10 

Other 14 

Total nonpositive reasons 215 76 

Positive reasons fi..r teririn .tion : 

Took anottier job 56 
Went to school 13 

Toti^l positive reasons jS9 24 

Total icentifiabi -jasons 284 100 

Unknown (note a) 58 

Total 342 

a/This iiiclude.; participants which the prime sponsor and the 
General Acccanting Office were unable to locata, those 
classified ai plac<?ments who never repor ted to the job, 
and those foi which no explanation was provided. 
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The nonpositive reasons account for about 76 percent of 
those known for participants leaving training. We believe 
many nonpositive terminations could have been avoid^ed had 
proper program services been provided. 

Assess ment p rocedur es should ide ntify 
particip an ts who desT re and are 
capable of comple t in 'g '^tr a in ing 

Assessment involves determining each participant's 
employability , aptitudes, abilities, and interests and 
developing a plan to achieve the participant's employment 
and related goals. Assessment is accomplished through inter- 
viewing, testing, and counseling. 

The assessment techniques varied from sponsor to sponsor. 
For example, some used a series of tes^ts and work sampling 
exercises to measure and evaluate participants* employment 
potential. Others only reviewed application forms and inter- 
viewed applicants. For example, the Lowell prime sponsor and 
the Marlboro subgrantee had a policy of not testing appli- 
cants but requiring them to complete work sampling exercises 
to assure that they would be. proper ly matched with jobs. 

Results of counseling sessio ns not_g ene r al 1. y 
documented showing how par ticipants ' problems 
were ide n tified a nd corrected 

Counseling helps participants assess their needs, abili- 
ties, and potential; provides guidance in developing voca- 
tional goals and the means to achieve them; and helps solve 
various individual problems. Counseling should be an ongoing 
process throughout a participant's training.' 

Absenteeism and personal problems, wh^ch counseling 
should help resolve, were major reasons foi participants not 
completing their OJT or leaving their jobi within 6 months. 
For the most part, participants' files did not identify per- 
sonal problems or causes for absenteeism. For example, in 
Lowell, although a client was fired for poor attendance and 
lack of motivation, the case history had no evidence that 
counseling was provided. Another particioant quit, citing 
emotional problems, yet the case history had no evidence 
that counseling was provid'^d. 

In Fall River, a training agent of ficial said that 
counseling was not provided to all OJT participants. As a 
result, some participants dropped out of OJT because of 
problems which counseling could have addressed. In one case. 
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a participant quit, citing personal problems, yet thr? case 
history contained no evidence that counseling was provided. 
In another case where ccunseling was provided, problems caus- 
ing the parcicipant to terminate from the program never sur- 
faced. For example, although the counsel ing 1 i le. showea tnau 
the participant was working out well with the employer, the 
participant walked off' the job 4 days later. 

In Santa Clara Valley, counseling sessions were supposed 
to be held with participants, according to prime sponsor guide- 
lines, but the results were not recorded in the participants' 
files. For example: 

— A keypunch operator trainee was fired for poor attend- 
ance just prior to completing the 4-week training 
period. The file contained no indication of attend- 
ance problems. 

— A participant quit after 6 weeks of training because 
the person was on drugs, but the file had no indica- 
tion of a drug problem and cited "moved from area" as 
the reason for quitting . 

— A locksmith trainee was fired after 5 weeks of train- 
ing because of poor attendance, lack of motivation, 
personal problems, and being unable to get along with 
others. There. was no indication of an attempt to re- 
solve these problems by counseling. 

Job development efforts must be direct ed 
toward jobs th at offer advancem ent 
opportunities and adequate wages 

Job development efforts should bo designed to get 
participants into jobs in which they will become self- 
sustaining and will have opportunities for career advance- 
ment. However, we found instances where participants were 
placed on jobs which had high turnover rates, were seasonal 
in nature, ^nd were low paying.^ 

In Stanislaus County, SESA negotiated an OJT contract 
with a turkey processing plant to train 34 participants as 
material handlers or packacers and 11 completed training. 
During a plant visit, it was noted that training inj/olved 
assembly line work which, according to a plant representa- 
tive, had a high turnover rate. An SESA official abreed 
that the jobs were undesirable, low paying, and low\killed, 
and that contracts for these positions would not be written 
in the future. 
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Iij Lowell, some participants were being tiained for * 
seasonal employment, altho»-gh the soonsor's OJT contract with 
the training ^qent prohibited this. Two OJT participants 
were hired as mechanic's helpers in the' landscaping field. . 
The sponsor believed these positions would be fuil-time and 
permanent jobs. However, according to the employer, these 
participants were only to be nired for 6 montl.s and it was 
customary for employees in this field to apply for unemploy- 
ment benefits during the lay-off period. The r.^jonsor's offi- 
cials were Unaware of 'this; but they agreed to discontinue 
negotiating OJT contracts for 5ear,onal wor k . 

Low-paying OJT ^>ositio.ns can discourage participants 
from completing their training and retaining their ]obs. 
For example, in Las Vegas, 20 (36 percent) of 56 narticir 
pants were still working with the OJT employer 6 .nonths 
after r:raining. Of those that quit, 15 were paid $3.00 
per hotr or less, and 10 were paid $2.50 per hour or less. 
Three wore paid more than $4.00 per hour. One former par- 
ticipant oeing trained as j mechanical assembler at $2.30 
per hour returned to his old job as a parkinq lot attendant 
which paid $4.00 per hour. The training agent's job developer 
stated that low wages give participants 1 ittle incentive to. 
stay on such jobs. 

In Stanislaus County, 66 percent of the OJT participants 
sampled who did not complete OJT or worked less than 6 months 
in unsuhsidized employment quit their jobs. The relatively 
low wa<^es paid to participants contributed to the hit^h number 
who quit. Eighty percent of those who quit were paid under 
$3.25 per hour. 

Poor job development efforts may also contribute to 
laying off OJT participants. The length of time that 
elapsed before participants were laid off varied. In some 
cases, it was soon after training began. For example, ^n 
Stanislaus Counter a participant for an electronics course 
was hired one day and laid off the next because there was no 
work. A brick mason participant was laid off 14 days aftier 
h2 was hired, due to lack of work. 
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[ CHAPTER 4 

NEED FOR IMPROVED .PROGRAM MANAGEMENT 



Neither Labor nor prime sponsors were effectively 
evaluating the perforr-ance of classroom training and OJT pro- 
grams. They did not have meaningful ^performance standa'-ds or 
adequate information about program re.^ults. For these reasons. 
Labor and prime sponsors continued to offer training proarams 
and courses which had low completion, placement, and retention 
ratec? were expensive; and were not cost effective. Labor 
doifs have indicators for measuring,, title I programs' perform- 
ance collectively/ but they cannot be used for individual title 
I activities. 



F'.-deral reports and prime sponsors' management informa- 
tion jystems did not provide data noec2d to adequately manage 
rlas'jroom training and OJT programs. 

Classroom training and- OJT programs should be monitored 
ar.d evaluated regularly. CETA requires prime sponsors to 
e.-^tablish systems ^to measure their programs' effectiveness 
•.n providing jobs to the unemployed. Labor and prime spon- 
sors were not adequately monitoring and evaluatinq classroom 
and OJT activities. 

The State Manpqwer Services Councils generally did not 
perform independent monitoring and evaluation requi;;ed by 
CETA, but reliod on datd'> generated bv the sponsors' management 
systems. Al' -^ough CETA requires monitoring and evaluation by 
the sponsors planniftg councils, their efforts were limited to 
reviewing data generated by sponsors' management information 
systems and quarterly reports submitted to Labor. 

P ERFORMANCE STANDARDS ARE NEEDED 

Labor has not established pe'-t:o''mance standards to 
measure individual title I program activities. Labor first 
published data on performance indicators in July 1976 to 
assist Labor reqional administrators in reviewing 1977 title 
I grant applications. These indicators were-- defined *:urther 
in March and Julv 1977 to be used for all Labor reviews and 
assessment processes, for fiscal year 1978 programs. Labor 
recognized that well-defined and consistent performance 
indicators provide a solid foundation for assessing 
title I activities. These indicators analyze such factors 
as the percentage of participants obtaining unsubsidized 
employment and the cost of placing individuals in employment. 
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However, because Labor established tne indicators t6 
'.measure overall title I pertormance, they cannot be used 
to measure the perLormance of such individual title I activi- 

♦^■^^^^i^g ^nd OJT. The. indicators are based 
allJ wn ''^^ authorized by title I including' youth and 

ad^lt work experience programs, public service employment, 
classroom training programs, and OJT programs. Placing a 
participant in an unsub'sidized job is not a primary goal 

;^^^/^experience, but it is for a classroom training or . 
an OJT program. . ^ ^ ^ » 

.,hnrh'^hfr'^'"''.*'° Labor's guidelines, work experience is a 
short-term work assignment with a public employer or non- 
profit employing agency. These programs should be designed 
to enhance youths' future employabil ity or to increase 
adults potential in attaining a planned occupational goal. 
However, the work situations are temporary and are not 
necessarily expected to result in unsubsidized employment 
ruT P^^'t^'^^^P^^ts. For this reason, classroom training and 
OJT activities should each have a higher job placement 
perfOL-mance standard than work experience programs if 
not, classroom training and OJT programs with low placement 
and completion rates may continue to be-offered because 
standards against which they were measured are inappropriate. 

' Lacking specific standards, prime sponsors and their 
delivery agents used a wide range of local goals to assess 
classroom training and OJT programs. The placement and com- 
pletion goals represent the oercentage of participants ex- 
pecL.ed to (1) complete classroom training and be placed in 
employment or (2) complete OJT training and continue employ- 
ment ..in unsubsidized positions with their training employers. 
The following table shows the range of the placement and 
completion goals used during fiscal year 1976. 
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Pr ime sponsor 



Classroom training OJT completion 
placement goals goals (note a j 



(percent) 

Boston, Mass. 
Chicago, 111. 
Hampden County, Mass. 
Lake County, ill. 
Las Vegas-Clark 

Cty., Nev. 
Lowell, Mass. 
Madison -Dane County^ 

Wis. 

Massachusetts balance 
of-State 
Fall River 
Marlboro 
Minnesota balance-of — 

State 
Oakland, Calif. 
Santa Clara Valley, 
Calif. 
• Stanislaus County^, 
Calif . 

a/OJT programs generally operated on a "hire-first, train- 
later*^ basis so that when participants completed their 
training period they continued as unsubsidized employees 
with the training employers. 

b/Represents the range of goals used by several classroom 
and OJT training agents under contr^iCt to the prime sponsor 

With the exception of Chicago, which did not have either 
formal or informal goal« for its classroom and OJT programs, 
the range of classroom training goals varied from 20 percent 
in Stanislaus to 85 percent in Lowell. OJT goals varied from 
49 percent in Las Vegas to 90 percent in Boston. Although 
standards may vary somewhat due to geographic or population 
factors, we do not believe the wide variations shown above 
were justified. Prime sponsors said that they established 
these goals based on those that were used by training agents 
in pre-CeXA categorical programs. However, little evidence 
demonstrated that these goals were established and evaluated 
in light of such factors as program performance, economic 
conditions, and target population served. 



65 

64 

35 

49 

85 

b/50-77 

77 

b/51-64 

60 
80 

64 

b/20-64 



90 

55 
50 

49 
80 

b/80-85 

65 
60 

60 
80 

80 

80 
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Goals should also apply to individual training courses. 
A training agent's overall classroom training per f or Tia..ce r„av 

""'^ ^ ''"^ '5°^^^' ^""^ some courses' poor performance 

may be hidden when combined with more successful ones. 

Labor ^"irnn?*HiSi"^ Overall title I perfornance indicators. 
Labor Old not aistinguisn between jobs that related to skill 
training ana those that did not. Also, indicators do not 
differentiate between temporary and permanent -iobs. We 
believe thac distinctions should be made for such differences. 

IMPROVEMENTS NEEDED IN LABOR AND PRIME 
SPONSOR MANAGEMENT INFORMATION SYStFmS 

Reports now required by Labor and prime sponsor manage- 
ment information systems do not adequately measure the 
training programs' performance. These quarterly reports 
required from prime sponsors to assess title I program ' 
performance, are not useful because iail activities' results 
^^^•^?^?o2"'^'c"'^'''"^ ''' i-^POsslble to evaluate the individual 
activities. Some prime snonsor management information systems 
hr^?n? P'^°^,^ding data by program activity on the numbe? of 
nf nilr-ln'r, r. t ^ Placements, length of job retention, costs 
of placing participants, and reasons why participants did not 
get or keep jobs after training. 

FpHer q 1 ' ?por t inq require ments 
not useful cools for evaFuatinq 
prime sponror activities 

Labor regulations require that sponsors report quarterly 
on title I activities. These reports need to be changod 
because da.a on overall program performance is not an effec- 
^,-no''T^"'"'5^"? format for evaluating the success of individual 
title I activities. Performance reports and annual plans 
combine participant job placement data for all program activi- 
ties. For example, prime sponsors may offer participants 
classroom training, OJT, work experience, and public service 
employment. Each program's effectiveness cannot be evaluated 
because the sponsor's report does not show, by activity, the 
number of participants obtaining jobs, the number of traininq- 
related ]obs from classroom training activity, costs per 
placement, or retention data. Therefore, Labor cannot deter- 
^nH^'.'jr ^"^^=^"^"1 an individual sponsor's classroom training 
and OJr programs are in placing participants in unsubsidized 
Dobs. Nevertheless, the sponsor's report is the basic docu- 
ment used by Labor to review a sponsor's performance 
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Management information systems 

generally do not provide 

program managers with needed data 

CETA requires that Labor shall not provide financial 
assistance for any program unless the program has adequate 
internal administrative and evaluation procedures to promote 
effective use of funds. 

However r even though CETA has been in existence for over 
3 yearsr none of the prime sponsors reviewed had an adequate 
management information system. Prime sponsors did not know 
hov successful training courses were in placing participants 
in training-related jobs, how expensive they were, and how 
long participants retained their jobs, or whether the reasons 
participants could not get or keep jobs were reasonable. 

During our review of the 12 prime sponsors' management 
information systems, we found that: 

— All summarized placement data, but 3 did not collect 
placements by program. 

— Two identified and summarized whether placements 
were training related. 

— Five recorded and summarized participant?* 
in keeping jobs. 

— Three computed cost per placement data. 

— Three summarized reasons participants did not get 
jobs. 

— None obtained and summarized reasons participants 
did not keep jobs. 

The following table summarizes data provided by the 
sponsors' mana'jenent information systems. 
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Summary of Data Provided by 
Prime Sponsor Management Information System 

Reasons 

Training- ReBSon for not 

related Job Cost per for non- keeping 
Prime sponsor Placements placements retention placement placement job 

Boston, Mass. X - (a) - . (a) 

Hampden County, Mass. X « • , . . 

Lowell, Mass, X , )( X - X - 

Balance-of -State 

Massachusetts b,/X - b/X b/X 

Oakland, Calif. X •• ~ X - ■ - . 

Santa Clara Valley, 

Calif. X X X X - - 

Las Vegas-Clark 

, Mounty, Nev. b/X - (c) - X - 

Stanislaus County, 

Calif. X - . - a/X 

Madison-Dane County, 

Wis. X - - • - - 

Lake County, 111. X . - 

Chicago, 111. X - - - 

Balance-of-State 

Minnesota b/X - b/X b/X • - 

Total 12 2 5 3 3 0 

a/The sponsor did perform a foUowup study on a sample basis in which the success 
of participants retaining jobs and the reasons for those not working were shown. 

^Not detailed by program activity. 

c/Although the system did not include followup, the prime sponsor contracted 
for a 1-year followup study. 
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Each prime sponsor can establ isn ' its own system based 
on its needs, but Labor published guidelines in April 1974 
to assist sponsors in designing adeouate systems. The guide- 
lines recognize that certain data is needed for prime sponsors 
to assess the effectiveness of their title I programs. Ac- 
cordingly, Labor suggests that management information systems 
Should include data on placements, training-related placements, 
30b retention, cost per placement, and reasons for partici- 
pants not being placed. Even with these guidelines, sponsors 
had not developed timely and useful systems. Labor needs 
to play a more active role in working with prime sponsors in 
establishing useful management Information systems. 

Varying placement, completion, and retention rates, and 
vailed program placement costs (see chs. 2 and 3) show that 
sponsors need this information. For example, failing to de- 
termine placement costs prevents prime sponsors from knowing • 
the cost effectiveness of different trainino urograms. In 
fiscal year 1976, including the transitional quarter, prime 
sponsors spent $578 million on classroom traininq and $180 
million on 9JT. Reviewing the 12 SDonsors showed that the 
average cost per unsubsidized placement for classroom training 
was more than double the average cost of OJT. Because the 
prime sponsors' management information system does not segre- 
gate data by program activity, officials of the sponsors 
could not distinguish pei-formance between their OJT and class- 
room training prograr.c. 

While prime sponsors should not red-'ce or eliminate 
classroom training based on tne review, they should consider 
such factors as cost per placement and job retention in eval- 
uating program performance. Because many prime sponsors do 
not have chis data, they cannot properly evaluate their pro- 
grams. In addition, the lack of cost standards by program 
activity makes program changes more difficult to develop 
and justify because there is little with which they can 
compare their program per f orcance . 

M?nage?r!orii: .information systems 
based on inadequate data 

Labor requires sponsors to report as placements only ' 
those who obtain employment hot subsidized by CETA. However, 
instances of inaccurate and unverified data were reported to 
Labor on the quarterly reports and also in prime sponsor 
management information systems. p.t two sponsors, records 
wer^missing or incomplete. As a result', Labor and prime 
spoiH^s were getting misleading impresFions on the placement 
succes>«is of training programs and courses. 
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For exampler Las Vegas reported as placements 13 classroom 
training participants who had obtained CETA public service 
employment jobs. This increased the number of placements 
for the year by 19 percent. But, prime sponsors ^re not 
allowed to record as placements those who have been referred 
to such other program activities as public service employment, 

Lowell enrollees who participated in both classroom 
training and OJT before being place?3 were picked up as place- 
ments by both agents in their repbrts to the prime sponsor. 
The prime sponsor, m preparing its quarterly report, did not 
net out the duplicate job placements. After this was brought to 
their attention, prime sponsor officials established procedures 
to prevent future double counting , 

^K Lako County and Chicago, missing or incomplete records 
pievttnted determining the employment status for about one 
quarter of the participants sampl-ed, Chicago classified some 
mdiviauals as classroom training participants although they 
were never enrolled in training, 

NEED TO IMPROVE LABOR AND PRIME 
SPONSOR MONITORING AND EVALUATION 

CETA requires sponsors to assure that services provided 
will be administered by or under their supervision. Further, 
CETA requires a strong and active Federal role in the program, 
including reviewing a sponsor's plan and assessing plan imple- 
^pp,..^,^^ ^.^y^ certain r. program complies with the act 
cind Labor's regulations. 

Labor and prime sponsors did not adequately monitor and 
evaluate classroom training and OJT programs. As a result, 
they were generally unaware of the programs' cost and varying 
placement and completion rates. JMthough prime sponsors 
are required to establish adequate program management and 
assessment systems which Labor reviews and approves, this was 
not done. Both Labor and prime sponsors were limited by 
inadequate performance standards and management information 
systems. Although State Manpower Services Councils and prime 
sponsors' Planning Councils are required to monitor and evalu- 
ate title I programs, their efforts were limited. They relied 
on data generated by inadequate management information sys- 
tems and generally did not question classroom training and OJT 
programs" effectiveness. 
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Need to improve recieral 
monitoring and evaluation 

Labor's field representatives were generally unaware of 
the situations the review identified because they did not 
adequately xavaluate classroom training and OJT programs. 
Labor's represercat ives made desk reviews of the quarterly 
Federal report:*' data, and made annual assessments that lacked 
the detail needed to identify ineffective training. 

The Labor representatives assigned to each prime sponsor 
are the focal p'-»int through which the prime sponsors' effec- 
tiveness is evaluated. Their monitoring activities consist 
of (1) routine contacts with prime sponsor officials either by 
teie^none or -occasional site visits, (2) desk reviews and 
evaluations o.: Federal reports, (3) an annual assessment of 
prime sponsor performance, and (4) reviews to determine 
whether sponsors are complying with CETA's requirements. It 
appears that the Labor representatives' desk reviews and 
annual assessments lack the necessary detail to identify 
specific operational problems. 

For example. Labor ' s Stanislaus County representative 
commented in the annual assessment that staffing levels 
and emphasis on monitoring were adequate and that all s"^- 
grantees had been audited. However, Stanislaus County was 
not able to perform any monitoring activities and reliec' 
on training agents to monitor their own operations. 

Labor's Chicago representative commented ^n the annual 
assessment that the prime sponsor's management information 
system was adequate to prepare reports which, as discuss i 
earlier, were not useful evaluative tools. The Labor repre- 
sentative did not evaluate the system's ability to provide 
more substantive data other than to say that a recently auto- 
mated system should enhance the ability and rtlectivenes ' 
of the prime sponsor's program planning. We f c und Cfiic. ^o's 
management information system lacked adequat»> inf or-r^at \ 
necessary for decisionmaking . 

For example, the fact that the systeirj did not contain * 
training-related placement data, job retention periods, cost 
per placement, and reasons for participants not getting and 
keeping jobs was not discussed by the Federal representative. 
Additionally, Labor ' s annual assessment of Chicago computed 
the cost of placing a title I (all activities combined) 
participant at over $16,000 for fiscal year 1976. Although 
Labor considered the cost per placement computation important 
in measuring program performance. Labor did not question the 
cost . 
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Labor representatives said that they do not have the 
time to perform indepth evaluations of program performance 
and, accordinqly, must rely on pr ime sponsors to identify 
specific problems, However, as discussed below, pri.xe spon- 
sors' monitorinq systems are generally inadequate and fre- 
quently fail to identify causes o£ poor program performance. 

Labor's headquarters is performing a national study 
designed to give an overall view of CETA's impact on partici- 
pants. It is not meant , however , to aid Labor's representa- 
tives in identifying and resolving problems in the individual 
sponsors' programs. 

This survey, "Continuous Longitudinal Manpower Survey, • 
has the principal purpose of providing measures of tne CETA 
program's impact on participants, particularly tneir earn- 
ings. Differences in earnings between preprogram and post- 
program periods are being measured for CETA participants 
and compared with similar changes in earnings for a compar- 
able group of nonpar ticipants . The survey will also provide 
participant characteristic data net available from the na- 
tional sponsor reporting system. Results are being obtained 
from sampling participant performance at 147 sponsors. 

Prime sponsor monitorinq and 
evaluation are inad e qua te 

CETA requires sponsors to establish internal procjram 
management procedures for monitoring day-to-day operations; 
periodically reviewing program performance in relation to 
program goals; and measuring the effectiveness of program 
cesulcs m terms of participants, program activities, and 
the community. So prime sponsors were unaware of thp low 
placement and completion rates discussed in chapters 2 and 3. 
For example, one sponsor did not have .monitor ing and 
evaluation capability, and otiiers were reluctant to enforce 
performance goals and use labor market data which forecasted 
surplus or low-demand occupations. Training courses which 
had low -placement rer.ults often continued to be offered. 

Prime sponsor monitoring generally consisted of onsite 
visits to training agent.: r :jc:jk reviews of management data, 
and periodic internal evaluations of program performance. 
All sponsors nad monitoring staffs, except Stanislaus County 
which relied on training agents to monitor their own opera- 
tions. A Madison-Dane official said that its one monitor 
was not able to make all the planned quarterly field visits, 
and only recently added an additional monitor for this 
purpose. 
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Dronp^Mn.f o sponsors disregarded labor market survey 
projections. Boston, Springfield, and Oakland ' s. labor mar- 
ket surveys all Identified courses with unfavorable labor 
market demand. Although these courses experionced low 
fhrfo??*" ^''''^^ sponsors continued the courses into 

Santf cJ^r.'S f!'"^ ^""^ P- ^5 details). Conversely, 

Santa Clara Valley performed an indepth analysis of individual 
^hf effectiveness and had take?, steps tS improv; 

the courses based on their analysis. improve 

cent/nf''?ni^n'°K^ classroom training program, 11 (10 per- 
pe?cen?l n'^'^?^"''^ ^^^"^ ^9^5 and 23 (20 

?raini^o r f I H^" S'^^'^^"''^ ^" ^^^"^ y^^"^ 19^6 obtained 
training related employment. Marlboro's CETA director said 
that he was totally unaware of these plac.ment Jelul?s, in- 
dicating a basic weakness in Marlboro's monitoring efforJs. 

St ate M an power Fervicps Council and prime 

sponsor Planning Coun^ l mnn^hnn'r^g 

and evaluation efforts iTmrtid 

-alua?ion"'rFTA and prime sponsor monitoring and 

.aluation, CETA requires each State to establish a Manpower 

ODe^aJ!on n^n^' ""^ requires the councils to monitor ?he 
ope ation of programs conducted by prime sponsors. CETA 

to^min!?n"'^^P'""" ^° establish B Plannir^g Council 

to monitor all manpower programs funded under t^tle I. 

State Manpower Services Councils were not devoting 
adequate time ^•.o evaluating program effectiveness because 
prIiritJ gIIT"^] of prime sponsors- plans had a higher 
lon^lar^inn °^""^^Jy' they did not perform independent 
oPnlr^^o^^K^ t:vMuation analyses, but relied on data 
generated by prime sponsors' management information systems 
and quarterly reports submitted to Labor. As a result hSp 
Councils- monitoring and evaluation effots were no? sub 
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cno.oo^ Manpower Services Councils' monitoring of prime 
f ?n! nr?r-r'°"l'" California and Massachuset?s ha° been 
a low priority. Their prima.-y efforts are related to (1) 

'Linnet °^ P'""^ "P""""-^ P^^"^' ^i'^^^ particular attent oi to 
population groups to be served, and (2) administering exSeri- 

ser"vices!°''''' '""'^ '° P^°^'^^ vocationfl"dCcati?n 

Generally, the involvement of the prime sponsor's Plan- 
ning Council in monitoring and evaluation was likewise 
limited. Rather than independently monitoring arSd evaluating 
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prime sponsors, the councils relied on Jiata generated by the 
prime sponsor management information systems and also the 
quarcerly reports submitted to Labor. As previously dis- 
cussed, the format of this data generated on program perfor- 
mance does not allow effective evaluations of program results 
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CHAPTER 5 
# — 

CONCLCJSIONS AND RCCOMMENDATIONS 

CONCLUSIONS 

Title I's purpose is to provide comprehensive manpower 
services needed to enable individuals to secure and retain 
employment at their maximum capacitv. Therefore, a basic 
factor for evaluating the success o'f title I training activi- 
ties IS tne extent to which former trainees obtained and 
retained employment. 

Eased on the sample, many classroom training and OJT 
af'^u^'^^u^"'^^^^'^ ^^^^ unsubsidized jobs, but mosc do not. 

Although some trainees may not have obtained employnent when 
they left training, they may have increased their enploya- 
bility. However, based on the sample, many of those that did 
not get jobs or left thera within 6 months were still unem- 
ployed when contacted. Often, they were on the unemploynient 
\insurance rolls. The costA)f placing participants in unsubsi- 
dized jobs varied significantly among the sponsors reviewed. 

\ The success of training programs is affected by such 
factors as the motivation and capabilities of individuals 
served by the sponsor and the economic conditions in the spon- 
sor s area. However, we believe the primary reasons for the 
wide variations in sponsors' performance were inadequacies 

^^^'^^^^'^'^^^"^"^ programs and related services that sponsors 
of f er ed . 

CETA employment and training services such as assessment, 
counseling, and job development are supposed to enhance 
participants' pr ospects^^f or completing training and for 
obtaining jobs. The serVices that sponsors gave were not 
always effective. In somS cases, services were not provided. 
Assessment practices cft^ did not accurately determine the 
participant's employability , aptitude, and interests. Coun- 
seling sessions did not appear to assist and guide partici- 
pants in resolving various personal problems. Job develop- 
ment and placement activities often did not identify job 
opportunities which would enable par ticipimts to become self- 
supporting and take advantage of training skills. Some 
training was conducted in occupations for which emplovment 
prospects were poor. Other training did not provid- partici- 
pants with sufficient skills to get training-related jobs. 
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"\r.r. Identify and help resolve these problems, prime spon- 
sors need accurate and precise information on their tiainKa 
prograrrs' etfectiveness. Management information sjsfems a 
key tool for obtaining first-hand knowledge of Jrlini'ng 
t ainfno^nr""''''""""' ^^^^^^V ^id not Ihow h^w Successful 
wMnh ^"""^ ""^ getting participants jbbs for 

which they were trained, how successful participants were 
in retaining those jobs, or how much the orogram cost In addi 
tion, management information systcn>s did not provide prime 
sponsors with the data needed to identify counseling ,^assess- 
mer ,nd job development problems. At two sponsors the 

either missing or incomplete. Because of the 
-or their management information systems, prime 
'^f^. .ors monitoring and evaluation efforts were inadequate. 

Under CETA's decentralized approach tc? deal u-th emplov- 
pMme'Snn''''"f"^ problems. Labor's role includes monitor ng 
ardr.rTnf" activities. To evaluate performance, stand- 
ards are necessary and must be tailored for each activity 

^Sp^p'ir^.""^" been slow in developing 

these standards. To date, very broad indicators (not ^ 
standards) have been established which onlv "'cz'^ure overall 
title I performance. Applying them to such individual 
program activities, as classroom training and OJT, is not 
appropriate as these activities have as a primary goal the 
placement of participants in unsubsidized employment; whereas 
work experience (another major activity under -^^lo ^> 
not have as its primary goal the unsubsidized placement"" " 
or individuals. 

..r^no^^r*"^^^,*^^ standards, prime sponsors are using a wide 
It nLrlV°fi measure their training programs' success. 

At nearly all sponsors reviewed, these goals were not being 
met.^ AS a resuJt, a wide range of performance for training 
programs exists. Until Labor sets performance standards and 
infnrll.Vr.'"^^ sponsors i n es t a bl i £ h i ng adequate management 

prnor^f ,2".^^^^^'"^'"'^'^ "'^^ ^^^^ to r.dequately monitor 

program performance. ^ j l 

HECOMMENDATIO.MS 

We recommend that the Secretary of Labor take a 
stronger and more active federal oversight role to nsuro 
that prime sponsors: 

—Offer training courses justified by lab r market 
surveys. 
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— Ree;ramine classroom training courses to assure 
tha^ the skill levels taught match the require- 
mek\ts Qf job openings. 

— Def^ign prevocat ional training programs leadiag 

to vocational skill training. ^ 

— Identify more accurately participants* 
employment needs and capabilities, 

— Document counseling sessions more precisely, 
with particular attention to how participant 
problems are being resolved. 

— Restructure job develo'pment services so that the 
job search begins well befoie participants 
complete training. Job interviews should bR 
arranged before or concur rent ly with the completion 
of training. 

— Design li.anagepent information systems to include (1) 
the success, of participants in obtaiiiing and 
retaining training-related employmeiit for each 
training course; (2) accurate reusons for partici- 
pants not completing training, not obtaining 
training-related enployment, or not retaining 
jobs; and (3) cost:*, of placing participants from 
each activity. 

— Expand monitoring and evaluation to include more 
indepth analysis of tr a ining. program effectiveness, 
with emphasis oi, reasonableness o£ training-related 
plac>2iu?nt and retention rates and costs. 

— Continue to fund only classrooom and OJT programs 
of demonstrated effectiveness. 

We recommend that the Secretary of Labor also: 

— Develop more specific and appropriate performance 
standards for each training activity by ( 1 ) 
differentiating between jobs related to skill b-raining 

^ and those that are not , and between jobs that are 
temporary ar.- those that are permanent: and (2) 
requiring prime sponsors to apply these standards 
to the training activity and, also, to individual 
training courses . 
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— Assure that prime sponsors (1) nave man- ' * I 

agoment information systems which provide 
the data discussed above, and (2) make 
adequate evaluations of program activities. 

— Revise the .quarterly Federal reports to provide 
adequate information to evaluate the training 
activities operated under title !• 

LABOR AND SPONSOR COMMENTS AND OUR EVALUATION 

I^bor, .In a March 27, 1978, letter (see app. V) generally 
agreed with our recommendations to improve CETA's employment 
and training programs. But Labor's response to som^ of our 
recommendations did not state what action would be taken with 
any specificity. Labor agreed to explore further or review 
many of the issues involved. Recognizing that there are 
many difficult issues involved in managing training programs, 
we believe that the time has come for definitive actions to 
be taken . 

Labor noted, however, that some of the problems cited in 
this report may have been due to the fact that our sample 
period covered activities of prime sponsors in the f^rst or 
early in the second year of managing their new responsibili- 
ties under CETA. Labor believes that most sponsors have 
performed more knowledgeably since then. The five prime 
sponsors who provided formal comments on this report also 
said that improvements have been made in their programs since 
our fieldwork. 

We r^ecognize that the sponsors have gone through a learn- 
ing process in managir. j CETA programs and have undoubtedly 
learned from experience: But our recommendations are aimed 
at improving the management system for training programs. 
Until these basic concepts are incorporated, no one can be 
sure that large amounts cjf Federal dollars for these programs 
are being spent effectively. 

Labor also said that the problems cited in the report 
varied widely among sponsors and that there is no common 
pattern of consistent managerial shortcomings which can 
readily be focused on. Further, each sponsor, in effect, 
is in a different stage of developing managerial capability, 
with its own strengths and weaknesses, so that a high degree 
of individualized actions are needed for general improvement. 
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In our viewr Labor's comments are only partially 
correct. It is true that pr ime . sponsor s are developing 
managerial capabilities at different rates. But the common 
pattern involved in dealing with managerial shortcomings is 
the need for a stronger and more active Federal oversight of 
the programs. Our recommendations are directed to this need. 
This clearly does not mean federalization of the programs, 
as noted by Labor r especially in light of the still evolving 
and unsettled nature of Federal versus local government roles 
in managing XETA programs. But, we believe that a need exists 
for >hG Department of Labor to adequately assist prime sponsors 
in decreasing the learning curve since the Department has many 
years of. experience in managing training progra^ms. 

Labor also pointed out that one. difficulty in establish- 
ing performance standards is the gauging of, whether the train- 
ing programs result in appreciable improvements for partici- 
pants over the-jlr preprogram . exper ience . For example Labor 
said that a placement or job retsention rate of 50 percent 
may be quite good for hard-to-place participants and quite 
bad for those witn prior stable work hi'Stories. 

We agree.' Our recommendat ipns dealing with the need 
to establish more specific performance standards for title I 
activities list some of the basic ingredients which we be- 
lieve are necessary for managers to effectively gauge the 
performance of training programs. While there are many 
variables in evaluatinq training programs, the primary" coar 
sideration is whether or not those trained actually obtained 
and retained jobs . Establishing specific standards on how 
•many should get and retain jobs, we believe, is a necessary 
first step in evaluating tc^aining programs. Measuring ac- 
complishment against standards would serve as a "flag** for 
program managers to further examine and assess which individ- 
ual training activities should be expandedj remain unchanged, 
changed, OL dropped. With the amount of money being spent 
on training activities, these activities should not continue 
to operate, year after year, without specific performance 
standards. 
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CHAPTE ; 6 
SCOPE OF ,^EVIEW 

/X,.,. We examined the effectiveness of classroom training and 
OJl programs--in terms of participants being placed, having 
retained their unsubsi^ized jobs, and the related costs- 
authorized under titlo' I of the Comprehensive Employment 
and iraining Act. Our review focused on: (1) the program's 
^mpacL on ^he participants ana (2) effectiven 3S of Labor 
and prime sponsor monitoring and program evaluation. These 
activities accounted for 42 percent of title I expenditures 
for fiscal years 1975-77. 

We reviewed (1) CETA and its legislative history: (2) 
Labor^regulations, policies, and operating procedures; and (3) 
records and documents, including placement records, reports, 
and participants' files maintained by Labor ^nd sponsors, 

. This review was performed primarily at Labor's regional 
offices in Boston, Chicago, and San Francisco; and 12 CETA 
sponsors in six States. The sponsors reviewed included loca- 
tion^ on the east coast, in the Midwest, and on the west coast 
and incluaed such different types of sponsors as States, con- 
sortia, and local governments. The list of locations follows 



State 
California 

Illinois 
Massachusetts 



Minnesota 

Nevada 
Wisconsin 



?r ime sponsor 

Stanislaus County 
Santa Clara Valley 
Oakland 
Lake County 
Chicago 

3alance-of -State 
Boston 

Lowell Consortium 
Hampden County 

Consortium 
Balance-of -State 



Las Vegas-Clark 
County Consortium 

Madison-Dane County 
Consortium 



Locat ion 

Modesto 
San Jose 
Oakland 
Waukegan 
Chicago 

Marlljoro, fall River 

(notp a ) 
Roston 
Lowell 
Springfield 

Ct .okston, Thief Riv'er 

Falls 
Willmar, Marshall, 
Worthington, Fairmont, 
Owatonna (note b) 
Las Vegas 

Madison 



a/Reviewed 2 of 18 balance-of-Stat e subgrantees. 

b/Reviewed 1 of 14 Comprehensive Employment and Training 
Center and subcenter locations. 
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We selected two 3amp:3s; (1) 2,043 participants (in- 
cluding 768 participants in the study noted below) who ter- 
minated prime sponsors' clajsroom training proqr^..n9; and 
(2) 80S participants who terminated OJT programs to determine 
their succers in obtainino and ret^iining unsubsidized employ- 
ment. Terminating parti npants included those who (1) ob- 
tained jobs after trail .nq, (2) completed training but did 
not got jobs, and (3) diu not complete training tor various 
reasons • 

Tho sample's base period was October 1 to Dect.mber 31, 
1975. 1/ We selected this period so that we would be able to 
determine the job status of participants 6 months after they 
terminated. We expanded the time frame and sample size in 
those situatii-ns where there were insufficient numbers of 
participants to evaluate. One prime sponsor completed a 
survey of 768 participants that terminated from classroom 
trainmr; programs between July 1, 1974 , and July 31, 1975, 
and addressed the same issues. Selectively, we verified the 
sponsor's data and used its results. 

We reviewed the participant files to examine the quality 
of employment and training services received and whether they 
obtained jobs. We contacted the employers of those who were 
placed to confirm when they were hired, when they left their 
jobs if they were not working, and whether the- jobs Lhey ob- 
tained related to the skills acquired during training. We 
contacted participants who dropped out of training and those 
who left their jobs within 6 months to determine their current 
employment status. We leviewed SESA records to determine 
if participants applied for unemployiuent insutance benefits 
after training . 



1/One sponsor, in commenting on this report, said that a 
sample of persons terminated during this quarter would 
not yield a representative sample because the group of 
persons terminating in the last quarter of the calendar 
year is heavily weighed with program dropputs. Conse- 
quently, we compared national data on the percentage of 
those persons leaving training with unsubsidized jobs 
(calculated using the total number of par ticipants leaving 
the program during the quarter as a base) during the sample 
quarter with other quartets during fiscal years 1975-77. 
V.u found that our sample quarter is representative. 
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we evI?uaJpH ?^hn^ reviewing sample participants' records, 
! ^""^ P''"'"^ sponsor monitoring and evalua- 

tion eftorts, and the usefulness of the data presented 
^?cr""^^^P°"^°'' '"^"^gemftnt information systems. We also 
discussed program operations with Labor, prime sponsor, and 
and'rpv^ ag.nt officials. We contacted repr esenLti ve^ of 
and reviewed the records of prime sponsor M::r.FOwer Plannina 
Councils and State Manpower Services Councils. ^^^""^"^ 
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Obtained 
S i itt p I « u n I ubBi d I ijd |ob 



Trilninq* 
NuifiLcr 7ercent 



Retained job 

C noftthi 
wuiiiber P*rcfnt 



doston, Ham. 
Ciica^Oi nil 
MaiDpdea County 

Consortium! Mass. 
Ui^ CoM\i, 111. 
Ur. Vifqai'dirk 

County Contort tuiiii Ney. 
Lovvll Ccnoorttuii, Niii. 
Holi^ro-Oane County 

Con!ortla<ii« 
.^aiSAChuietti H3lance*o(- 

f^W Fiver 
.larlboro 
Minnriiota Aalance^ol-State 

I note i| 
uatUnd; Callt. 
Sani4 Claci Valley, CalK, 

(note b) 
Stannlaus Countyf CalK. 

total 

Average 

a/Kesalti based on review o( 1 o( U State Comprehenilve Citployient and Training 
^ Center and Sub-center locations. 
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b/Kiiultt t>iiid on iptciil (ollowup itudy p«;(ocHd by iponsor. Rttintlon band 
** on I lO-nonth period. (Set p. I.) 
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CLASSROOM TRAINING COSTS 
TO OBTAIN UNSUBSIDIZED EHPLOYMRNT 



t^rime sponsor 

flocton , Mass. 
Chicago, 111. 
Hfl.T.pden County 

Cor.sor t ium, Mass. 
LaKe County, ill. 
Las Vegas-Clafk 

County Consortium, 

Nev . 

Lowell Consortium, 
Mass . 

Madison-Dane County 

Consortium, Wis. 
Massachusetts Balance- 

of -State : 
Fall Rivet 
Mar Iboro 
Minnesota Balance- 

of -State 
Oakland, Calif. 
Santa Clara Valley, 

Calif. 
Stanislaus County, 

Calif. 

Average 



Cost per 
placement 
( note a ) 

$ 4,790 
15,124 

9,197 
6,700 



14,335 
6,604 
2,817 

4,222 
5,925 

7,126 
4,462 

4,435 

6,135 

$ 7,618 



Cost adjusted for 
training-related 
placement 7 note a ) 

$ 6,303 
19,900 

11,216 
(b) 



27,567 
12,007 
3,658 

4,222 
8,977 

11,134 
6,112 

5,475 

11,798 

$10,157 



a/See chapter 2 for discussion of cost computation. 

b/Lake County primarily operated a pr -vocational training 
program. There were not sufficient training-related 
Placements from it- classroom training program to 
compute costs. 
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APPENDIX III 



0N-THE-J()3 TRAINING SAMPLE PLACEMENT 
AND 6-MONTH HETKNTION RESULTS 



Sample 

Prime sponsor siz^ 
Boston, Macs. 24 

Cnicago, ill. 197 

Hampden County Consorr'urw 

Mass* 23 

LaKe County, m. 35 

Las Vegas-Clark County 

Consortium, Nev. 56 

Lowell Consortium, Mass. 65 

Madison-Dane County 

Consortium, Wis. 22 

Massachusetts Balance- 
of -State : 

Fall River 22 

Marlboro 3 »; 

Minnesota Balance-o^f- 

State (note a) 71 

OaKland, Calif eo 

Santu Clara Valley, Calif. 46 

Stanislaus County, Calif. 152 

Total e09 



Obtained 
unsubs id i zed 
^ QTPp^ oymen t 
Number 



7 

112 

14 

17 

46 
34 

14 



8 

3 



46 

56 

35 
73 
467 



Pe rcent 
29 
57 

61 
47 

62 

52 

64 



36 
20 



66 

70 

76 
46 
56 



Ketained job 
6 montnii 



Number 

92 

6 
11 

20 
29 



40 

35 

13 
43 

305 



l-'e r cent 
7\ 
47 

26 
il 

36 
45 

32 



9 
13 



56 
44 

28 

28 
38 



a/Reaults based on review of 7 of 14 State Comprehensive 
Training Center and Subcenter locations. 
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ON-THE-JOQ TRAINING COSTS TO O RTAIM 
UNSUB3IDIZED EMPLOYMENT 

Cost per 

Prime sponsor placement (note a 

Boston, Mass. ciii caa 

Chicago, 111. 5JJ'644 

Hampden County Consortium, Mass. t'cqt 

Lake County, 111. " 

Las Vegas-Clark County ^>/^^ 

Consortium, Nev. 2 Qt;Q 

Lowell Consortium, Mass. 3059 

Madison-Dane County Consortium, ' 

Wis. 2 438 

Massachusetts Balance-of -State ' 

Mar'^hJro" 2,889 

Marlboro 2 oan 

Minnesota Balance-of-State ? i i ^ 

Oakland, Calif. f'f!^ 

Santa Clara Valley, Calif. 3709 

btanislaus County, Calif. I'sSl 



^^"^y" $ 3,522 

a/See chapter 2 .for discussion of cost computation. 
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U.S, DEPARTMENT OF LABOR 

OrricB OP iHB Assistant Secretary # 
WASMINOTON 



MARCH 27, 1978 



Mr. Gregory Ahart 
Director^ Human Resources Division 
U. S. General Accounting Office 
200 Constitution Avenue, N. W. 
Washington, D. C. 20210 

Dear Mr. Ahart: 

In accordance with your request of February 23, 1978, to 
Secretary Marshall, we are submitting comments on the 
General Accounting Office's (GAO) draft report. 

(See GAO Note.) 

We consider the report to be' well done. It appears well- 
balanced and sensitive to many of the complexities of training 
program management. There are three elements of perspective 
we feel are not given explicit recognition by ♦■^^^ rpnnrt. 
Thes? elements do not alter the genera?, merit of your recom- 
mend, r ions, but do help explain some of the administrative 
shortc mings cited. They are: 

1. Th€i survey examined training conducted in 1975 and 
trainees terminated in October - December 1975. CETA 
sponsors were in their first or early in the second 
year of managing their new responsibilities. Most have 
performed more Icnowledgeably since then, we believe. 1^ 

2. The ^problems cited varied widely by sponsor. There is 
not a common pattern of several consistent managerial 
shortcomings which can readily be focused on. Each 
sponsor in effect is in a dlLferent stage of development 
of r.anagerial capability, with it^ own strengths and 
weaknesses, so that a high degree of individualized 
actions are needed for general improvement. 

3. The survey of trainees provides no sense of their prior 
labor market difficulties, so it is difficult, as GAO 
acknowledges, to gauge the extent to which their post*^" 
program experience represents ail appreciable improvement. 
A placement or job retention rate of 50 percent may be 
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dilemma fo^any eff^i fo%^^^^ ^^i^^orics. The 

based on ratls^ol p^acemenris^'^^frjfir 

achieved for easier-to-olSL ^ better rates are 

jay do well wUhou^ the^p^Sgra'^rin'??; lo:\tLT°'' 
be common for the hard-tS-emplSi Jet rep?osenJ f 
. maSy"^o^'^?SeV"^'^^ unattaLaSle^ i.pro^v^^^nt ?or 

The draft report included the following recommendations: 
We recommend that the SPnrA^;»r•./ ^♦r r 

and more active Federal S"rsi^h? ro?e°^o'-'^ ^ stronger 
sponsors: --ywv. Loxe co insure that prime 

" Sa":et'sCrveJI;"°""^^ ^-^^^-d by labor 

Sffg me?hod"1or'"L%'is£!no"'^°""^"'^^'°" - 

more adequate labor raarkoJ fif^ ^'.'^ ^P^^^ors to develop 

stood t^t adequa?e Tabor ma?ket"l;Jo?; 

to obtain. We do not ant iM^^^! i^^''?u-'°" difficult 
resolved immedia?«l°: ^"'^''^^P^^^^ ^^^^ this problem can be 

thrikin training courses to assure that 

job opeiingir''' requirement! of Jhe 

I^^;ocL%'^o°rr"L^ii^ng'ex^s?^r^"^^^^°"• 

that needs to be revi^Co^ ^^^^ clearly an area 

looking into develop no n.?;of P"^°'^^' ^asis. We are also 
the quIlity°or?ra?^J^^ ^"rses!"" ^^^"^"^^ ^or reviewing 

" ^l:nc^^'V^l[^^'^ ^^^^ ^ead to 

iffogt'go achieSe-U,is':L?''^" "'-•^^ every ' 
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— identify more accurately participants' employment needs 
and capabilities. 

RESPONSE . We concur with this recommendation. As with 
the development of labor market information, Lhis is an 
area m which the Department has consistently attempted 
to assure acceptable performance. At the present time, the 
Department has a research contract which we hope will pro- 
vide recommendations or methods that CETA prime soonsors 
can utilize to more effectively evaluace participants' 
needs^ current skills and aspirations. The new CETA legis- 
lation contains language that will require a closer linkage 
between prime sponsors and the employment servic (ES) in 
this area. • . v / 

— Document counseling sessions more precisely with particular 
attention to how participant problems are being resolved. 

RESPONSE . We will review this issue to determine the extent 
of any problems and to develop, as necessary, any appropriate 

policies. J ' J trc f 

restructure 
sec 
jot 

with the completion of training. 

RESPONSE. We can concur with the reasoning behind this 
recommendation. We will review this area with a view to 
assisting prime sponsors to develop more appropriate job 
search procedures. The new legislation is also proposing 
new requirements in this area. 

— design management information systems to include (1) the 
success of participants in obtaining and retaining 
training related employment for each training course; 
(2) accurate reasons for participants not completing 
training, not obtaining training related employment 
or not retaining jobs; and, (3) costs of placing 
participants from each activity. 
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RESPOfiSE. Vio concur with the basic purpose .of this 
recommendation. Over the past year it has become appaient 
that Congress and other parties are interested in more 
detailed - ^formation than is currently obtained through 
the existing reporting systems. Therefore, we are now in 
,the process of reviewing the new inforrnatl n needs as well 
as a way to change the existing system so that these new 
informational needs can be collected effectively and 
efficiently. We also intend to take into consideration 
needs generated as a result of the new CETA legislation. 

— expand mortitoring and instruction to include more 
in-depth analysis of training program ef fectiveness 
with emphasis on reasonableness of training related 
placement and retention rates and costs. 

RESPPNSE . We concur with this recommendation. We are in 
the process of reviewing our current monitoring and eviiitu- 
ation systems. New demandr. on and views of the CETA 
concept ha» e created a need for more in-d*:pth ceviews of 
major pares of the. system. We are in the procejjs of 
developing methods to satisfy these new needs* 

— continue to fund only classroom and on-the-job training 
programs of deaionstrated effectiveness. 

RESPONSE . We concur v^ith this recommendation. 

c 

— develop more specific and appropriate performance 
standards for each traini;.g activity differentiation 
between jobs related to skill training and those that 
are not between jobs that are temporary and those that 
are permanent? ana require prime spon::ors to apply 
them not only to the training activity but also to 
individual training courses. 

RESPONSE . We concur v th the need for better and more 
.appropriate performan - standards. The development of 
realistic oerformance :itandards has been an area of great^ 
concern to the Department since the implementation of CETA. 
We are and will continue to review our sy^items for adequately 
measuring prime sponsor performance with a view to developing 
procedures which will enable uiS to fairly and accurately 
determine the effectiveness of each prime sponsor. The - 
areas recommended above are areas that are and will continue 
to be included as key areas of per'^^rmance that need to be 
evaluated in order to determine performance effectiveness. 
Considerable research is already underway with respect to 
developing more and better measures of performance. 
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It muflt be lecognized, however, that this recommendation 
concerns the stili evolving and u.^aettled nature of Federal 
y^^5"^«i?^*^ government -oles in managing oC the decentral- 
ized CETA programs. This is particularly relevant to 
suggestions that the Departm-nt ot Labor should, in ita 
o/ersisht roles," "require" or "assure that" the local 
sponsors do speciific things in specific ways. 

This is the basic reason why we "have been slow in developing" 
national performance standards. A great deal of attention 
has been devoted to it, in close consultation with 8i>onsor 
representatives after initial efforts found undesirable 
Side-effects \f initially developed standards, but there 
18 still a que».tion on how to combine effectively the 
objective of improved managerial performance through use 
of workable standards huitable for diverse settings and 
?i° 4^ffi*"^ objective of soonsor discretion and 
flexibility in devising overall programs and individual 
projects tailored to local circumstances. 

— assure that' prime sponsor!! (1) have management information 
systems which provide the data discussed above, and 
12) make adequate evaluations of program activities. 

RESPONSE. Vfe concur with the need for more extensive prime 
sponsor, MIS and evaluation systems, our current: review 
of Che existing monitoring, evaluation and MIS systems include 
a review of the prime sponsor's part in these systems. Or.ce 
wtr have finalized our new system, prime sponsors will be 
required or requeateti, an appioprxate, co incorporate relevant 
new procedures, 

~ revise quarterly Federal reports to provide adequate 
information to» evaluate the training activities operated 
under title I. ' , 

RESPONSE . We concuv that some appropriate changes are needed. 
Appropriate changes in reporting forms are anticipated once 
we have determined exactly what the new information require- 
menta need to be and once we have assured ourselves that 
the current data systems can provide or can be modified 
to provide the nece^ary information. 

Sincerely, 




ZU2 

Tstint s/c/etary for 
Unistra^j^n and Management 



HAO Note: 



Deleted comment refer^ to material contained in the 
prooosed report which has been revised in the final 
report . 
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: RINCIPAL DEPARTMENT OF LABOR OFFICIALS 
RESPONSIBLE FOR \DM I N I STERING 
ACTIVITIES DISCUSSED IN THIS RKPQRT 



Tenure of off ire 
From To' 



SECRETARY: 

Ray Marshall 

W. J. Usery, Jr. 

John T. Dunlop 

ASSISTANT SECRETARY FOR 
EMPLOYMENT AND TRAINING: 

Ernest G. Green 
. William B. Hewitt (acting) 
William H. Kolberg 



Jan. 1977 
Feb. 1976 
Feb. 1975 



Mar. 1977 
Feb. 1977 
Apr. 1973 



Present 
Jan/ 1977 
Jan. 1976 



Present 
Mar. 1977 
Jan. 1977 



(205b3) 



\ 
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